Michael Zeng

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng

NeurIPS 2024 | May 2024

Publication Project

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng

NeurIPS 2024 | April 2024

DOI Publication Project

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication Download

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei

IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518

Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication Project

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint Project

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

Optimizing Alignment of Speech and Language Latent Spaces for End-to-End Speech Recognition and Understanding

Wei Wang, Shuo Ren, Yao Qian, Shujie Liu, Yu Shi, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication Publication

Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

Zhengyang Chen, Sanyuan Chen, Yu Wu, Yao Qian, Chengyi Wang, Shujie Liu, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data

Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang

2021 International Conference on Machine Learning | July 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Sefik Emre Eskimez, Liyang Lu, Hong Qu, Michael Zeng

ICASSP2021 | June 2021

Publication

Speech-language Pre-training for End-to-end Spoken Language Understanding

Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng

ICASSP 2021 | June 2021

Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2102.06578 | February 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Question Answering

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

ACL-IJCNLP 2021 | December 2020

Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-oriented Spoken Dialog

Yao Qian, Yu Shi, Michael Zeng

InterSpeech2020 | October 2020

Publication

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.

Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

2020 Empirical Methods in Natural Language Processing | March 2020

DOI Publication

Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization

Beliz Gunel, Chenguang Zhu, Michael Zeng, Xuedong Huang

NeurIPS 2019, Knowledge Representation & Reasoning Meets Machine Learning(KR2ML) Workshop | December 2019

Publication

Make Lead Bias in Your Favor: A Simple and Effective Method for News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

arXiv 1912.11602 | December 2019

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

Meeting Transcription Using Asynchronous Distant Microphones

Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang

Interspeech | September 2019

Publication Project Project

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Meeting Transcription Using Virtual Microphone Arrays

Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng

MSR-TR-2019-11 | July 2019

Published by Microsoft

Revised version

Publication Project Project

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng

NeurIPS 2024 | May 2024

Publication Project

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng

NeurIPS 2024 | April 2024

DOI Publication Project

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication Download

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei

IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518

Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint Project

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data

Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang

2021 International Conference on Machine Learning | July 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Sefik Emre Eskimez, Liyang Lu, Hong Qu, Michael Zeng

ICASSP2021 | June 2021

Publication

Speech-language Pre-training for End-to-end Spoken Language Understanding

Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng

ICASSP 2021 | June 2021

Publication

Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2102.06578 | February 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Question Answering

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

ACL-IJCNLP 2021 | December 2020

Publication

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-oriented Spoken Dialog

Yao Qian, Yu Shi, Michael Zeng

InterSpeech2020 | October 2020

Publication

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.

Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

2020 Empirical Methods in Natural Language Processing | March 2020

DOI Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Meeting Transcription Using Virtual Microphone Arrays

Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng

MSR-TR-2019-11 | July 2019

Published by Microsoft

Revised version

Publication Project Project

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng

NeurIPS 2024 | May 2024

Publication Project

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng

NeurIPS 2024 | April 2024

DOI Publication Project

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Optimizing Alignment of Speech and Language Latent Spaces for End-to-End Speech Recognition and Understanding

Wei Wang, Shuo Ren, Yao Qian, Shujie Liu, Yu Shi, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication Publication

Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

Zhengyang Chen, Sanyuan Chen, Yu Wu, Yao Qian, Chengyi Wang, Shujie Liu, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication

Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Sefik Emre Eskimez, Liyang Lu, Hong Qu, Michael Zeng

ICASSP2021 | June 2021

Publication

Speech-language Pre-training for End-to-end Spoken Language Understanding

Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng

ICASSP 2021 | June 2021

Publication

Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-oriented Spoken Dialog

Yao Qian, Yu Shi, Michael Zeng

InterSpeech2020 | October 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Meeting Transcription Using Asynchronous Distant Microphones

Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang

Interspeech | September 2019

Publication Project Project

Meeting Transcription Using Virtual Microphone Arrays

Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng

MSR-TR-2019-11 | July 2019

Published by Microsoft

Revised version

Publication Project Project

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication Download

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication Project

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint Project

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

Publication

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei

IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518

Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication Project

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint Project

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data

Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang

2021 International Conference on Machine Learning | July 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Sefik Emre Eskimez, Liyang Lu, Hong Qu, Michael Zeng

ICASSP2021 | June 2021

Publication

Speech-language Pre-training for End-to-end Spoken Language Understanding

Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng

ICASSP 2021 | June 2021

Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2102.06578 | February 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Question Answering

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

ACL-IJCNLP 2021 | December 2020

Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-oriented Spoken Dialog

Yao Qian, Yu Shi, Michael Zeng

InterSpeech2020 | October 2020

Publication

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.

Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

2020 Empirical Methods in Natural Language Processing | March 2020

DOI Publication

Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization

Beliz Gunel, Chenguang Zhu, Michael Zeng, Xuedong Huang

NeurIPS 2019, Knowledge Representation & Reasoning Meets Machine Learning(KR2ML) Workshop | December 2019

Publication

Make Lead Bias in Your Favor: A Simple and Effective Method for News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

arXiv 1912.11602 | December 2019

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

Meeting Transcription Using Asynchronous Distant Microphones

Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang

Interspeech | September 2019

Publication Project Project

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

Meeting Transcription Using Virtual Microphone Arrays

Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng

MSR-TR-2019-11 | July 2019

Published by Microsoft

Revised version

Publication Project Project

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

i-Code Studio: A Configurable and Composable Framework for Integrative AI

Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang

The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024

Publication

Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

Bin Xiao, Haiping Wu, Weijian Xu, Xiyang Dai, Houdong Hu, Yumao Lu, Michael Zeng, Ce Liu, Lu Yuan

CVPR 2024 | June 2024

Preprint Publication

TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation

Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng

NeurIPS 2024 | May 2024

Publication Project

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations

Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng

NeurIPS 2024 | April 2024

DOI Publication Project

Unifying Vision, Text, and Layout for Universal Document Processing

Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal

The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023

Publication Download

Any-to-Any Generation via Composable Diffusion

Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal

NeurIPS 2023 | May 2023

Publication

Automatic Prompt Optimization with “Gradient Descent” and Beam Search

Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng

May 2023

Publication

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang

ACL 2023 | May 2023

Publication Publication

i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data

Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023

Publication

Generate rather than Retrieve: Large Language Models are Strong Context Generators

Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang

ICLR 2023 | May 2023

Publication

i-Code: An Integrative and Composable Multimodal Learning Framework

Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang

AAAI 2023 | February 2023

Publication

Narrate Dialogues for Better Summarization

Ruochen Xu, Chenguang Zhu, Michael Zeng

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation

Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022

PDF

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng

EMNLP 2022 | December 2022

Publication

Automatic Rule Induction for Efficient Semi-Supervised Learning

Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022

Publication

AdaPrompt: Adaptive Model Training for Prompt-based NLP

Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Unsupervised Summarization with Customized Granularities

Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han

Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022

Publication

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

IJCAI 2022 | July 2022

human parity result on CommonsenseQA

Publication

CLIP-Event: Connecting Text and Images with Event Structures

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022

Publication

An Empirical Study of Training End-to-End Vision-and-Language Transformers

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng

CVPR | June 2022

Publication Publication Project

End-to-End Segmentation-based News Summarization

Yang Liu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data

Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

ACL 2022 | May 2022

Publication

DICT-BERT: Enhancing Language Model Pre-Training with Dictionary

Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang

ACL 2022 | May 2022

Preprint

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng

ACL 2022 | May 2022

Publication

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization

Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

AAAI 2022 | February 2022

Publication

JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng

AAAI 2022 | February 2022

Publication

Optimizing Alignment of Speech and Language Latent Spaces for End-to-End Speech Recognition and Understanding

Wei Wang, Shuo Ren, Yao Qian, Shujie Liu, Yu Shi, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication Publication

Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

Zhengyang Chen, Sanyuan Chen, Yu Wu, Yao Qian, Chengyi Wang, Shujie Liu, Yanmin Qian, Michael Zeng

ICASSP 2022 | October 2021

Publication

Want To Reduce Labeling Cost? GPT-3 Can Help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng

Conference on Empirical Methods in Natural Language Processing | August 2021

Publication

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng

ACL-IJCNLP 2021 | August 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Reasoning

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021

Publication

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data

Chengyi Wang, Yu Wu, Yao Qian, Kenichi Kumatani, Shujie Liu, Furu Wei, Michael Zeng, Xuedong Huang

2021 International Conference on Machine Learning | July 2021

Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021

PDF Publication

Leveraging Lead Bias for Zero-shot Abstractive News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021

Publication

Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Sefik Emre Eskimez, Liyang Lu, Hong Qu, Michael Zeng

ICASSP2021 | June 2021

Publication

Speech-language Pre-training for End-to-end Spoken Language Understanding

Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng

ICASSP 2021 | June 2021

Publication

MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization

Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng

NAACL | March 2021

PDF Publication

Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders

Junwei Liao, Yu Shi, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2102.06578 | February 2021

Publication

Fusing Context Into Knowledge Graph for Commonsense Question Answering

Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang

ACL-IJCNLP 2021 | December 2020

Publication

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-oriented Spoken Dialog

Yao Qian, Yu Shi, Michael Zeng

InterSpeech2020 | October 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.

Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

2020 Empirical Methods in Natural Language Processing | March 2020

DOI Publication

Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization

Beliz Gunel, Chenguang Zhu, Michael Zeng, Xuedong Huang

NeurIPS 2019, Knowledge Representation & Reasoning Meets Machine Learning(KR2ML) Workshop | December 2019

Publication

Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue

Chenguang Zhu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2019

Publication

Meeting Transcription Using Asynchronous Distant Microphones

Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang

Interspeech | September 2019

Publication Project Project

SIM: A Slot-Independent Neural Model for Dialogue State Tracking

Chenguang Zhu, Michael Zeng, Xuedong Huang

The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019

Publication

LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng

May 2023

PDF

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT

Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng

May 2023

PDF

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang

December 2021

Preprint Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

MACSum: Controllable Summarization with Mixed Attributes

Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang

Transactions of the Association for Computational Linguistics | March 2023

Publication

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei

IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518

Publication

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

arXiv preprint arXiv:2111.11432 | November 2021

Publication Project

Does Knowledge Help General NLU? An Empirical Study

Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng

arXiv: Computation and Language | September 2021

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding

Yu-An Chung, Chenguang Zhu, Michael Zeng

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang

North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021

Publication

A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining

Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

Mixed-Lingual Pre-training for Cross-lingual Summarization

Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020

Publication

Meta Dialogue Policy Learning

Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng

arxiv 2006.02588 | June 2020

Publication

Make Lead Bias in Your Favor: A Simple and Effective Method for News Summarization

Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang

arXiv 1912.11602 | December 2019

Publication

SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering

Chenguang Zhu, Michael Zeng, Xuedong Huang

arXiv | December 2018

Publication

Meeting Transcription Using Virtual Microphone Arrays

Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng

MSR-TR-2019-11 | July 2019

Published by Microsoft

Revised version

Publication Project Project