Model as a Game: On Numerical and Spatial Consistency for Generative Games
Jingye Chen, Yuzhong Zhao, Yupan Huang, Lei Cui, Li Dong, Tengchao Lv, Qifeng Chen, Furu Wei
March 2025
March 2025
论文与出版物
-
-
-
Chain-of-Retrieval Augmented Generation
Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, Furu Wei
January 2025
-
-
-
Little Giants: Synthesizing High-Quality Embedding Data at Scale
Haonan Chen, Liang Wang, Nan Yang, Yutao Zhu, Ziliang Zhao, Furu Wei, Zhicheng Dou
NAACL 2025 | October 2024
-
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
-
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
作者：Microsoft
-
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
-
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
-
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
-
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
-
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
-
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
-
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
-
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
-
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
-
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
-
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
-
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
-
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
-
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
-
Generative Representational Instruction Tuning
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
ICLR 2025 | February 2024
-
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
作者：Microsoft
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
ACL 2024 | January 2024
-
-
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
-
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, 第 57 卷(2)
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
-
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
-
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
SIGIR 2024 | October 2023
-
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
-
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
-
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
-
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, 第 60 卷(5)
-
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
-
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
-
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
-
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
-
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
作者：Microsoft
-
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
-
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
-
-
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
-
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
-
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
-
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
-
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
-
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
-
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
-
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
-
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
-
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
-
-
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
-
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
-
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
-
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
-
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
-
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
-
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
-
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
-
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
-
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
-
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
-
-
-
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
-
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
-
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
-
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
-
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
-
-
-
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
-
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
-
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
-
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
-
-
-
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
-
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
-
Neural Open Information Extraction
ACL 2018 | July 2018
-
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
-
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
-
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
-
-
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
-
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
-
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
-
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
-
-
-
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
-
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
-
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
-
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
-
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
-
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
-
-
-
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
-
-
-
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
-
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
-
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
-
-
Model as a Game: On Numerical and Spatial Consistency for Generative Games
Jingye Chen, Yuzhong Zhao, Yupan Huang, Lei Cui, Li Dong, Tengchao Lv, Qifeng Chen, Furu Wei
March 2025
March 2025
-
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
-
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
作者：Microsoft
-
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
-
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
-
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
-
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
-
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
-
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
-
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
-
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
-
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
-
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
-
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
-
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
-
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
-
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
-
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
作者：Microsoft
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
-
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
-
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
-
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
-
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
-
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
-
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
-
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
-
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
-
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
-
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
-
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
-
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
-
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
-
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
-
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
-
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
-
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
-
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
-
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
-
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
-
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
-
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
-
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
-
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
-
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
-
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
-
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
-
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
-
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
-
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
-
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
-
-
-
Chain-of-Retrieval Augmented Generation
Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, Furu Wei
January 2025
-
Little Giants: Synthesizing High-Quality Embedding Data at Scale
Haonan Chen, Liang Wang, Nan Yang, Yutao Zhu, Ziliang Zhao, Furu Wei, Zhicheng Dou
NAACL 2025 | October 2024
-
Generative Representational Instruction Tuning
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
ICLR 2025 | February 2024
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
ACL 2024 | January 2024
-
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, 第 57 卷(2)
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
-
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
SIGIR 2024 | October 2023
-
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
-
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
-
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, 第 60 卷(5)
-
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
-
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
-
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
-
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
-
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
作者：Microsoft
-
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
-
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
-
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
-
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
-
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
-
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
-
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
-
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
-
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
-
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
-
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
-
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
-
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
-
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
-
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
-
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
-
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
-
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
-
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
-
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
-
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
-
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
-
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
-
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
-
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
-
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
-
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
-
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
-
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
-
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
-
Neural Open Information Extraction
ACL 2018 | July 2018
-
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
-
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
-
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
-
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
-
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
-
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
-
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
-
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
-
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
-
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
-
-
Chain-of-Retrieval Augmented Generation
Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, Furu Wei
January 2025
-
Little Giants: Synthesizing High-Quality Embedding Data at Scale
Haonan Chen, Liang Wang, Nan Yang, Yutao Zhu, Ziliang Zhao, Furu Wei, Zhicheng Dou
NAACL 2025 | October 2024
-
Generative Representational Instruction Tuning
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
ICLR 2025 | February 2024
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
ACL 2024 | January 2024
-
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, 第 57 卷(2)
-
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
SIGIR 2024 | October 2023
-
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
-
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
-
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
-
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
-
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
-
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
-
-
-
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
-
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
-
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
-
-
-
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
-
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
-
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
-
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
-
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
-
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
-
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
-
-
-
Model as a Game: On Numerical and Spatial Consistency for Generative Games
Jingye Chen, Yuzhong Zhao, Yupan Huang, Lei Cui, Li Dong, Tengchao Lv, Qifeng Chen, Furu Wei
March 2025
March 2025
-
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
-
-
-
Chain-of-Retrieval Augmented Generation
Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, Furu Wei
January 2025
-
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
-
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
-
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
-
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
-
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
-
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
-
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
-
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
-
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
-
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
-
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
-
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
-
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
-
-
-
Little Giants: Synthesizing High-Quality Embedding Data at Scale
Haonan Chen, Liang Wang, Nan Yang, Yutao Zhu, Ziliang Zhao, Furu Wei, Zhicheng Dou
NAACL 2025 | October 2024
-
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
-
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
-
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
-
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
-
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
-
Generative Representational Instruction Tuning
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
ICLR 2025 | February 2024
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
ACL 2024 | January 2024
-
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
SIGIR 2024 | October 2023
-
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
-
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
-
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
-
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
-
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
-
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
-
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
-
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
-
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
-
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
-
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
-
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
-
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
-
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
-
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
-
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
-
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
-
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
-
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
-
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
-
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
-
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
-
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
-
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
-
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
-
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
-
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
-
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
-
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
-
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
-
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
-
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
-
Neural Open Information Extraction
ACL 2018 | July 2018
-
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
-
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
-
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
-
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
-
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
-
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
-
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
-
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
-
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
-
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
-
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
-
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
-
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
-
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
-
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
-
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
-
-
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
作者：Microsoft
-
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
作者：Microsoft
-
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
作者：Microsoft
-
-
-
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, 第 57 卷(2)
-
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, 第 60 卷(5)
-
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, 第 16 卷(6): pp. 1505-1518
-
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
-
-
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
-
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
-
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
-
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
-