Hao Cheng

Principal Researcher

Publications

View by:

- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Project
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Download
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Download
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Download
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication

- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Project
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Download
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Project
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Download
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Download
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Download
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Download
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Download
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication

- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Project
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Download
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Download
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Download