Return to Microsoft Research Lab – Redmond

Knowledge and Language Team

Papiers de Collaboration

View by:

- i-Code Studio: A Configurable and Composable Framework for Integrative AI
  
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024
  
  PDF Publication
- Global Selection of Contrastive Batches via Optimization on Sample Permutations
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  ICML 2023 | July 2023
  
  PDF Publication
- Unifying Vision, Text, and Layout for Universal Document Processing
  
  Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
  
  Publication Download
- Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
  
  Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
  
  Publication
- Fine-Tuning Language Models with Advantage-Induced Policy Alignment
  
  Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao
  
  June 2023
  
  Publication
- In-Context Demonstration Selection with Cross Entropy Difference
  
  Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu
  
  May 2023
  
  Arxiv
  
  Publication
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
  
  Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
  
  May 2023
  
  Publication
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- Small Models are Valuable Plug-ins for Large Language Models
  
  Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley
  
  May 2023
  
  Publication
- Automatic Prompt Optimization with “Gradient Descent” and Beam Search
  
  Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  Publication
- Generate rather than Retrieve: Large Language Models are Strong Context Generators
  
  Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
  
  ICLR 2023 | May 2023
  
  Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT
  
  Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- LMGQS: A Large-scale Dataset for Query-focused Summarization
  
  Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
  
  Chaojun Wang, Yang Liu, Wai Lam
  
  ACL 2023 Findings | May 2023
  
  Publication Publication
- Prompting GPT-3 To Be Reliable
  
  Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
  
  International Conference on Learning Representations (ICLR 23) | May 2023
  
  PDF
- UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization
  
  Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  ACL 2023 | May 2023
  
  Publication Publication
- G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
  
  Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu
  
  arXiv 2303.16634 | March 2023
  
  Publication
- MACSum: Controllable Summarization with Mixed Attributes
  
  Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
  
  Transactions of the Association for Computational Linguistics | March 2023
  
  Publication
- How Does In-Context Learning Help Prompt Tuning?
  
  Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer
  
  February 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- Narrate Dialogues for Better Summarization
  
  Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Publication
- A Unified Encoder-Decoder Framework with Entity Memory
  
  Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- AdaPrompt: Adaptive Model Training for Prompt-based NLP
  
  Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- Automatic Rule Induction for Efficient Semi-Supervised Learning
  
  Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
  
  Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Best Paper Award at SoCal NLP Symposium 2022
  
  PDF Publication
- FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
  
  Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
  
  December 2022
  
  Publication
- Leveraging Locality in Abstractive Text Summarization
  
  Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  EMNLP 2022 | December 2022
  
  Publication Publication
- ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
  
  Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
  
  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
  
  PDF
- Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
  
  Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- Task Compass: Scaling Multi-task Pre-training with Task Prefix
  
  Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
  
  EMNLP 2022 | December 2022
  
  Publication
- Towards A Unified Multi-Dimensional Evaluator For Text Generation
  
  Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- Unsupervised Summarization with Customized Granularities
  
  Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  
  Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  PDF
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication Project
- CLIP-Event: Connecting Text and Images with Event Structures
  
  Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
  
  Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
  
  Publication
- Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
  
  Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang
  
  ACL 2022 | May 2022
  
  Publication
- End-to-End Segmentation-based News Summarization
  
  Yang Liu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
  
  Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
  
  ACL 2022 | May 2022
  
  Preprint
- DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization
  
  Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  ACL 2022 | May 2022
  
  Publication
- KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
  
  Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Knowledge in Multilingual Commonsense Reasoning
  
  Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
  
  Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
  
  ACL 2022 | May 2022
  
  Publication
- Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents
  
  Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
  
  ACL 2022 | May 2022
  
  Publication
- Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
  
  Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
  
  Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
  
  Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint Project
- The Elastic Lottery Ticket Hypothesis
  
  Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication Project
- An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next
  
  Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Injecting Entity Types into Entity-Guided Text Generation
  
  Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Accelerating Real-Time Question Answering via Question Generation
  
  Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu
  
  arXiv: Computation and Language | September 2021
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- Does Knowledge Help General NLU? An Empirical Study
  
  Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng
  
  arXiv: Computation and Language | September 2021
- Universal Sentence Representations Learning with Conditional Masked Language Model
  
  Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
  
  EMNLP 2021 | August 2021
  
  Publication
- DialSumm: A Real-Life Scenario Dialogue Summarization Dataset
  
  Yulong Chen, Yang Liu, Liang Chen, Yue Zhang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- Fusing Context Into Knowledge Graph for Commonsense Reasoning
  
  Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- Retrieval Enhanced Model for Commonsense Generation
  
  Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- Want To Reduce Labeling Cost? GPT-3 Can Help
  
  Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Conference on Empirical Methods in Natural Language Processing | August 2021
  
  Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
  
  PDF Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
  
  Publication
- Enhancing Factual Consistency of Abstractive Summarization
  
  Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
  
  Yu-An Chung, Chenguang Zhu, Michael Zeng
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- Noisy Self-Knowledge Distillation for Text Summarization
  
  Yang Liu, Sheng Shen, Mirella Lapata
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication Publication
- Filtered Inner Product Projection for Crosslingual Embedding Alignment
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  International Conference on Learning Representations (ICLR) | May 2021
  
  Publication
- Sentence-Permuted Paragraph Generation
  
  Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021
  
  Publication
- MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization
  
  Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng
  
  NAACL | March 2021
  
  PDF Publication
- A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining
  
  Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication
- A Survey of Knowledge-Enhanced Text Generation
  
  Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang
  
  arXiv 2010.04389 | October 2020
  
  Publication
- Mixed-Lingual Pre-training for Cross-lingual Summarization
  
  Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang
  
  The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020
  
  Publication
- Meta Dialogue Policy Learning
  
  Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng
  
  arxiv 2006.02588 | June 2020
  
  Publication
- Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
  
  Chenguang Zhu
  
  SIGDial 2020 | May 2020
  
  Publication
- Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2019
  
  Publication
- SIM: A Slot-Independent Neural Model for Dialogue State Tracking
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
  
  Publication
- Embedding Imputation with Grounded Language Information
  
  Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
  
  The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
  
  Publication
- Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
  
  Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
  
  Publication Project
- SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  arXiv | December 2018
  
  Publication
- FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension
  
  Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen
  
  Sixth International Conference on Learning Representations, ICLR 2018 | January 2018
  
  Publication

- i-Code Studio: A Configurable and Composable Framework for Integrative AI
  
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024
  
  PDF Publication
- Unifying Vision, Text, and Layout for Universal Document Processing
  
  Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
  
  Publication Download
- Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
  
  Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
  
  Publication
- Fine-Tuning Language Models with Advantage-Induced Policy Alignment
  
  Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao
  
  June 2023
  
  Publication
- In-Context Demonstration Selection with Cross Entropy Difference
  
  Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu
  
  May 2023
  
  Arxiv
  
  Publication
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
  
  Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
  
  May 2023
  
  Publication
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- Automatic Prompt Optimization with “Gradient Descent” and Beam Search
  
  Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  Publication
- UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization
  
  Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  ACL 2023 | May 2023
  
  Publication Publication
- LMGQS: A Large-scale Dataset for Query-focused Summarization
  
  Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT
  
  Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
  
  Chaojun Wang, Yang Liu, Wai Lam
  
  ACL 2023 Findings | May 2023
  
  Publication Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Prompting GPT-3 To Be Reliable
  
  Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
  
  International Conference on Learning Representations (ICLR 23) | May 2023
  
  PDF
- How Does In-Context Learning Help Prompt Tuning?
  
  Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer
  
  February 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- Narrate Dialogues for Better Summarization
  
  Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Publication
- ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
  
  Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
  
  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
  
  PDF
- Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
  
  Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Best Paper Award at SoCal NLP Symposium 2022
  
  PDF Publication
- FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
  
  Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
  
  December 2022
  
  Publication
- Task Compass: Scaling Multi-task Pre-training with Task Prefix
  
  Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
  
  EMNLP 2022 | December 2022
  
  Publication
- Automatic Rule Induction for Efficient Semi-Supervised Learning
  
  Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- Unsupervised Summarization with Customized Granularities
  
  Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- CLIP-Event: Connecting Text and Images with Event Structures
  
  Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
  
  Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
  
  Publication
- End-to-End Segmentation-based News Summarization
  
  Yang Liu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
  
  Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
  
  Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
  
  ACL 2022 | May 2022
  
  Preprint
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint Project
- The Elastic Lottery Ticket Hypothesis
  
  Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication Project
- Universal Sentence Representations Learning with Conditional Masked Language Model
  
  Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
  
  EMNLP 2021 | August 2021
  
  Publication
- Want To Reduce Labeling Cost? GPT-3 Can Help
  
  Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Conference on Empirical Methods in Natural Language Processing | August 2021
  
  Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
  
  PDF Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
  
  Publication
- Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2019
  
  Publication
- SIM: A Slot-Independent Neural Model for Dialogue State Tracking
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
  
  Publication
- Embedding Imputation with Grounded Language Information
  
  Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
  
  The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
  
  Publication
- Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
  
  Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
  
  Publication Project
- SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  arXiv | December 2018
  
  Publication
- FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension
  
  Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen
  
  Sixth International Conference on Learning Representations, ICLR 2018 | January 2018
  
  Publication
- i-Code Studio: A Configurable and Composable Framework for Integrative AI
  
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024
  
  PDF Publication
- Global Selection of Contrastive Batches via Optimization on Sample Permutations
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  ICML 2023 | July 2023
  
  PDF Publication
- Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
  
  Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
  
  Publication
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
  
  Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
  
  May 2023
  
  Publication
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- Small Models are Valuable Plug-ins for Large Language Models
  
  Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley
  
  May 2023
  
  Publication
- LMGQS: A Large-scale Dataset for Query-focused Summarization
  
  Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
  
  Chaojun Wang, Yang Liu, Wai Lam
  
  ACL 2023 Findings | May 2023
  
  Publication Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Prompting GPT-3 To Be Reliable
  
  Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
  
  International Conference on Learning Representations (ICLR 23) | May 2023
  
  PDF
- Generate rather than Retrieve: Large Language Models are Strong Context Generators
  
  Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
  
  ICLR 2023 | May 2023
  
  Publication
- G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
  
  Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu
  
  arXiv 2303.16634 | March 2023
  
  Publication
- MACSum: Controllable Summarization with Mixed Attributes
  
  Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
  
  Transactions of the Association for Computational Linguistics | March 2023
  
  Publication
- How Does In-Context Learning Help Prompt Tuning?
  
  Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer
  
  February 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
  
  Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
  
  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
  
  PDF
- Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
  
  Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Best Paper Award at SoCal NLP Symposium 2022
  
  PDF Publication
- Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
  
  Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
  
  Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
  
  December 2022
  
  Publication
- Task Compass: Scaling Multi-task Pre-training with Task Prefix
  
  Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
  
  EMNLP 2022 | December 2022
  
  Publication
- Towards A Unified Multi-Dimensional Evaluator For Text Generation
  
  Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- A Unified Encoder-Decoder Framework with Entity Memory
  
  Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- Leveraging Locality in Abstractive Text Summarization
  
  Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  EMNLP 2022 | December 2022
  
  Publication Publication
- Automatic Rule Induction for Efficient Semi-Supervised Learning
  
  Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- AdaPrompt: Adaptive Model Training for Prompt-based NLP
  
  Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- Unsupervised Summarization with Customized Granularities
  
  Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication Project
- Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  
  Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  PDF
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- CLIP-Event: Connecting Text and Images with Event Structures
  
  Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
  
  Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication Project
- Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
  
  Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang
  
  ACL 2022 | May 2022
  
  Publication
- End-to-End Segmentation-based News Summarization
  
  Yang Liu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
  
  Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
  
  ACL 2022 | May 2022
  
  Publication
- Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
  
  Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents
  
  Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
  
  ACL 2022 | May 2022
  
  Publication
- DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization
  
  Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Knowledge in Multilingual Commonsense Reasoning
  
  Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
  
  Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
  
  ACL 2022 | May 2022
  
  Preprint
- KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
  
  Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
  
  Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
  
  Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint Project
- An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next
  
  Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Injecting Entity Types into Entity-Guided Text Generation
  
  Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Does Knowledge Help General NLU? An Empirical Study
  
  Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng
  
  arXiv: Computation and Language | September 2021
- Accelerating Real-Time Question Answering via Question Generation
  
  Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu
  
  arXiv: Computation and Language | September 2021
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- Universal Sentence Representations Learning with Conditional Masked Language Model
  
  Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
  
  EMNLP 2021 | August 2021
  
  Publication
- Want To Reduce Labeling Cost? GPT-3 Can Help
  
  Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Conference on Empirical Methods in Natural Language Processing | August 2021
  
  Publication
- DialSumm: A Real-Life Scenario Dialogue Summarization Dataset
  
  Yulong Chen, Yang Liu, Liang Chen, Yue Zhang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- Retrieval Enhanced Model for Commonsense Generation
  
  Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- Fusing Context Into Knowledge Graph for Commonsense Reasoning
  
  Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
  
  PDF Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
  
  Publication
- SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
  
  Yu-An Chung, Chenguang Zhu, Michael Zeng
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- Enhancing Factual Consistency of Abstractive Summarization
  
  Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- Noisy Self-Knowledge Distillation for Text Summarization
  
  Yang Liu, Sheng Shen, Mirella Lapata
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication Publication
- Filtered Inner Product Projection for Crosslingual Embedding Alignment
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  International Conference on Learning Representations (ICLR) | May 2021
  
  Publication
- Sentence-Permuted Paragraph Generation
  
  Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021
  
  Publication
- MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization
  
  Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng
  
  NAACL | March 2021
  
  PDF Publication
- A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining
  
  Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- A Survey of Knowledge-Enhanced Text Generation
  
  Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang
  
  arXiv 2010.04389 | October 2020
  
  Publication
- Mixed-Lingual Pre-training for Cross-lingual Summarization
  
  Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang
  
  The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020
  
  Publication
- Meta Dialogue Policy Learning
  
  Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng
  
  arxiv 2006.02588 | June 2020
  
  Publication
- Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
  
  Chenguang Zhu
  
  SIGDial 2020 | May 2020
  
  Publication
- Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2019
  
  Publication
- SIM: A Slot-Independent Neural Model for Dialogue State Tracking
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
  
  Publication
- Embedding Imputation with Grounded Language Information
  
  Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
  
  The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
  
  Publication
- Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
  
  Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
  
  Publication Project
- i-Code Studio: A Configurable and Composable Framework for Integrative AI
  
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024
  
  PDF Publication
- Unifying Vision, Text, and Layout for Universal Document Processing
  
  Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
  
  Publication Download
- Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
  
  Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
  
  Publication
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication Project
- Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  
  Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  PDF
- CLIP-Event: Connecting Text and Images with Event Structures
  
  Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
  
  Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication Project
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint Project
- The Elastic Lottery Ticket Hypothesis
  
  Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication Project
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- Automatic Prompt Optimization with “Gradient Descent” and Beam Search
  
  Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  Publication

- Fine-Tuning Language Models with Advantage-Induced Policy Alignment
  
  Banghua Zhu, Hiteshi Sharma, Felipe Vieira Frujeri, Shi Dong, Chenguang Zhu, Michael I. Jordan, Jiantao Jiao
  
  June 2023
  
  Publication
- In-Context Demonstration Selection with Cross Entropy Difference
  
  Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu
  
  May 2023
  
  Arxiv
  
  Publication
- PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
  
  Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
  
  May 2023
  
  Publication
- LMGQS: A Large-scale Dataset for Query-focused Summarization
  
  Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT
  
  Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  PDF
- FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
  
  Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
  
  December 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint Project
- i-Code Studio: A Configurable and Composable Framework for Integrative AI
  
  Yuwei Fang, Mahmoud Khademi, Chenguang Zhu, Ziyi Yang, Reid Pryzant, Yichong Xu, Yao Qian, Takuya Yoshioka, Lu Yuan, Michael Zeng, Xuedong Huang
  
  The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP24 Demo Track) | October 2024
  
  PDF Publication
- Global Selection of Contrastive Batches via Optimization on Sample Permutations
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  ICML 2023 | July 2023
  
  PDF Publication
- Unifying Vision, Text, and Layout for Universal Document Processing
  
  Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
  
  Publication Download
- Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
  
  Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
  
  The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
  
  Publication
- Any-to-Any Generation via Composable Diffusion
  
  Zineng Tang, Ziyi Yang, Chenguang Zhu, Michael Zeng, Mohit Bansal
  
  NeurIPS 2023 | May 2023
  
  Publication
- Small Models are Valuable Plug-ins for Large Language Models
  
  Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley
  
  May 2023
  
  Publication
- Automatic Prompt Optimization with “Gradient Descent” and Beam Search
  
  Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
  
  May 2023
  
  Publication
- UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization
  
  Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  ACL 2023 | May 2023
  
  Publication Publication
- Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
  
  Chaojun Wang, Yang Liu, Wai Lam
  
  ACL 2023 Findings | May 2023
  
  Publication Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Prompting GPT-3 To Be Reliable
  
  Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
  
  International Conference on Learning Representations (ICLR 23) | May 2023
  
  PDF
- Generate rather than Retrieve: Large Language Models are Strong Context Generators
  
  Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
  
  ICLR 2023 | May 2023
  
  Publication
- How Does In-Context Learning Help Prompt Tuning?
  
  Simeng Sun, Yang Liu, Dan Iter, Chenguang Zhu, Mohit Iyyer
  
  February 2023
  
  Publication
- i-Code: An Integrative and Composable Multimodal Learning Framework
  
  Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  AAAI 2023 | February 2023
  
  Publication
- Narrate Dialogues for Better Summarization
  
  Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Publication
- ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
  
  Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
  
  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
  
  PDF
- Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
  
  Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
  
  2022 Empirical Methods in Natural Language Processing | December 2022
  
  Best Paper Award at SoCal NLP Symposium 2022
  
  PDF Publication
- Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
  
  Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- Task Compass: Scaling Multi-task Pre-training with Task Prefix
  
  Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
  
  EMNLP 2022 | December 2022
  
  Publication
- Towards A Unified Multi-Dimensional Evaluator For Text Generation
  
  Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han
  
  Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
  
  Publication
- A Unified Encoder-Decoder Framework with Entity Memory
  
  Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- Leveraging Locality in Abstractive Text Summarization
  
  Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  EMNLP 2022 | December 2022
  
  Publication Publication
- Automatic Rule Induction for Efficient Semi-Supervised Learning
  
  Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
  
  Publication
- AdaPrompt: Adaptive Model Training for Prompt-based NLP
  
  Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- Unsupervised Summarization with Customized Granularities
  
  Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
  
  Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication Project
- Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  
  Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  PDF
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- CLIP-Event: Connecting Text and Images with Event Structures
  
  Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
  
  Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication Project
- Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
  
  Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang
  
  ACL 2022 | May 2022
  
  Publication
- End-to-End Segmentation-based News Summarization
  
  Yang Liu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
  
  Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
  
  ACL 2022 | May 2022
  
  Publication
- Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
  
  Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents
  
  Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
  
  ACL 2022 | May 2022
  
  Publication
- DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization
  
  Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
  
  ACL 2022 | May 2022
  
  Publication
- Leveraging Knowledge in Multilingual Commonsense Reasoning
  
  Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
  
  Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
  
  ACL 2022 | May 2022
  
  Preprint
- KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
  
  Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
  
  ACL 2022 | May 2022
  
  Publication
- DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
  
  Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
  
  Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng
  
  AAAI 2022 | February 2022
  
  Publication
- The Elastic Lottery Ticket Hypothesis
  
  Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication Project
- An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next
  
  Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Universal Sentence Representations Learning with Conditional Masked Language Model
  
  Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
  
  EMNLP 2021 | August 2021
  
  Publication
- Want To Reduce Labeling Cost? GPT-3 Can Help
  
  Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
  
  Conference on Empirical Methods in Natural Language Processing | August 2021
  
  Publication
- DialSumm: A Real-Life Scenario Dialogue Summarization Dataset
  
  Yulong Chen, Yang Liu, Liang Chen, Yue Zhang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- Retrieval Enhanced Model for Commonsense Generation
  
  Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- Fusing Context Into Knowledge Graph for Commonsense Reasoning
  
  Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang
  
  The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
  
  Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
  
  PDF Publication
- Leveraging Lead Bias for Zero-shot Abstractive News Summarization
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
  
  The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
  
  Publication
- Noisy Self-Knowledge Distillation for Text Summarization
  
  Yang Liu, Sheng Shen, Mirella Lapata
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication Publication
- MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization
  
  Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng
  
  NAACL | March 2021
  
  PDF Publication
- Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2019
  
  Publication
- SIM: A Slot-Independent Neural Model for Dialogue State Tracking
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
  
  Publication
- Embedding Imputation with Grounded Language Information
  
  Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
  
  The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
  
  Publication
- Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
  
  Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
  
  Publication Project
- FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension
  
  Hsin-Yuan Huang, Chenguang Zhu, Yelong Shen, Weizhu Chen
  
  Sixth International Conference on Learning Representations, ICLR 2018 | January 2018
  
  Publication
- G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
  
  Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu
  
  arXiv 2303.16634 | March 2023
  
  Publication
- MACSum: Controllable Summarization with Mixed Attributes
  
  Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
  
  Transactions of the Association for Computational Linguistics | March 2023
  
  Publication
- Injecting Entity Types into Entity-Guided Text Generation
  
  Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
  
  Publication
- Does Knowledge Help General NLU? An Empirical Study
  
  Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng
  
  arXiv: Computation and Language | September 2021
- Accelerating Real-Time Question Answering via Question Generation
  
  Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu
  
  arXiv: Computation and Language | September 2021
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
  
  Yu-An Chung, Chenguang Zhu, Michael Zeng
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- Enhancing Factual Consistency of Abstractive Summarization
  
  Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
  
  Publication
- Filtered Inner Product Projection for Crosslingual Embedding Alignment
  
  Vin Sachidananda, Ziyi Yang, Chenguang Zhu
  
  International Conference on Learning Representations (ICLR) | May 2021
  
  Publication
- Sentence-Permuted Paragraph Generation
  
  Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang
  
  Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021
  
  Publication
- A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining
  
  Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
  
  Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- A Survey of Knowledge-Enhanced Text Generation
  
  Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang
  
  arXiv 2010.04389 | October 2020
  
  Publication
- Mixed-Lingual Pre-training for Cross-lingual Summarization
  
  Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang
  
  The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020
  
  Publication
- Meta Dialogue Policy Learning
  
  Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng
  
  arxiv 2006.02588 | June 2020
  
  Publication
- Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
  
  Chenguang Zhu
  
  SIGDial 2020 | May 2020
  
  Publication
- SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering
  
  Chenguang Zhu, Michael Zeng, Xuedong Huang
  
  arXiv | December 2018
  
  Publication