Azure Florence project header: eye + language = AI represents visual-language learning

Project Florence-VL

Publications

View by:

- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  ECCV | October 2022
  
  Publication
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
  
  Chenfei Wu, Jian Liang, Xiaowei Hu, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
  
  NeurIPS 2022 | July 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication
- LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
  
  Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | June 2022
  
  Published by Microsoft
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
  
  Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | June 2022
  
  Publication
- GIT: A Generative Image-to-text Transformer for Vision and Language
  
  Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | May 2022
  
  Published by Microsoft
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication
- Scaling Up Vision-Language Pre-training for Image Captioning
  
  Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | March 2022
  
  Publication
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
  
  AAAI 2022 | February 2022
  
  Publication
- OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
  
  Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- Playing Lottery Tickets with Vision and Language
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
  
  Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  NeurIPS 2021 | December 2021
  
  Publication
- VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
  
  Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
  
  arXiv preprint arXiv:2111.12681 | November 2021
  
  Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication
- UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  
  Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  arXiv preprint arXiv:2111.10023 | November 2021
  
  Publication
- Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
  
  Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Compressing Visual-Linguistic Model via Knowledge Distillation
  
  Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- End-to-End Semi-Supervised Object Detection with Soft Teacher
  
  Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Mesh Graphormer
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication
- End-to-End Human Pose and Mesh Reconstruction with Transformers
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  CVPR 2021 | June 2021
  
  Publication
- Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
  
  Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu
  
  CVPR 2021 | June 2021
  
  CVPR 2021 Best Paper
  
  Publication Github
- DAP: Detection-Aware Pre-training with Weak Supervision
  
  Yuanyi Zhong, Jianfeng Wang, Lijuan Wang, Jian Peng, Yu-Xiong Wang, Lei Zhang
  
  CVPR 2021 | June 2021
  
  Publication
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication
- TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
  
  Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
  
  CVPR 2021 | June 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
  
  Linjie Li, Zhe Gan, Jingjing Liu
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication
- Large-Scale Adversarial Training for Vision-and-Language Representation Learning
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, JJ (Jingjing) Liu
  
  NeurIPS 2020 | December 2020
  
  PDF
- HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
  
  Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, Jingjing Liu
  
  Conf. on Empirical Methods in Natural Language Processing (EMNLP 2020) | November 2020
  
  Publication
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project
- Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
  
  Jize Cao, Zhe Gan, Yu Cheng, Licheng Yu, Yen-Chun Chen, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- UNITER: UNiversal Image-TExt Representation Learning
  
  Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF

- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  ECCV | October 2022
  
  Publication
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
  
  Chenfei Wu, Jian Liang, Xiaowei Hu, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
  
  NeurIPS 2022 | July 2022
  
  Publication
- LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
  
  Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | June 2022
  
  Published by Microsoft
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
  
  Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | June 2022
  
  Publication
- GIT: A Generative Image-to-text Transformer for Vision and Language
  
  Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | May 2022
  
  Published by Microsoft
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication
- Scaling Up Vision-Language Pre-training for Image Captioning
  
  Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | March 2022
  
  Publication
- OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
  
  Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
  
  AAAI 2022 | February 2022
  
  Publication
- Playing Lottery Tickets with Vision and Language
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
  
  Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  NeurIPS 2021 | December 2021
  
  Publication
- VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
  
  Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
  
  arXiv preprint arXiv:2111.12681 | November 2021
  
  Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication
- UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  
  Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  arXiv preprint arXiv:2111.10023 | November 2021
  
  Publication
- Compressing Visual-Linguistic Model via Knowledge Distillation
  
  Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication
- Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
  
  Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu
  
  CVPR 2021 | June 2021
  
  CVPR 2021 Best Paper
  
  Publication Github
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
  
  Linjie Li, Zhe Gan, Jingjing Liu
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication
- Large-Scale Adversarial Training for Vision-and-Language Representation Learning
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, JJ (Jingjing) Liu
  
  NeurIPS 2020 | December 2020
  
  PDF
- HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
  
  Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, Jingjing Liu
  
  Conf. on Empirical Methods in Natural Language Processing (EMNLP 2020) | November 2020
  
  Publication
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project
- Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
  
  Jize Cao, Zhe Gan, Yu Cheng, Licheng Yu, Yen-Chun Chen, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- UNITER: UNiversal Image-TExt Representation Learning
  
  Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  ECCV | October 2022
  
  Publication
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
  
  Chenfei Wu, Jian Liang, Xiaowei Hu, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
  
  NeurIPS 2022 | July 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication
- LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
  
  Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | June 2022
  
  Published by Microsoft
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
  
  Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | June 2022
  
  Publication
- GIT: A Generative Image-to-text Transformer for Vision and Language
  
  Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | May 2022
  
  Published by Microsoft
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication
- Scaling Up Vision-Language Pre-training for Image Captioning
  
  Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | March 2022
  
  Publication
- OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
  
  Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
  
  AAAI 2022 | February 2022
  
  Publication
- Playing Lottery Tickets with Vision and Language
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
  
  Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  NeurIPS 2021 | December 2021
  
  Publication
- VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
  
  Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
  
  arXiv preprint arXiv:2111.12681 | November 2021
  
  Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication
- UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  
  Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  arXiv preprint arXiv:2111.10023 | November 2021
  
  Publication
- Mesh Graphormer
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- End-to-End Semi-Supervised Object Detection with Soft Teacher
  
  Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
  
  Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Compressing Visual-Linguistic Model via Knowledge Distillation
  
  Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication
- End-to-End Human Pose and Mesh Reconstruction with Transformers
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  CVPR 2021 | June 2021
  
  Publication
- Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
  
  Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu
  
  CVPR 2021 | June 2021
  
  CVPR 2021 Best Paper
  
  Publication Github
- TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
  
  Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
  
  CVPR 2021 | June 2021
  
  Publication
- DAP: Detection-Aware Pre-training with Weak Supervision
  
  Yuanyi Zhong, Jianfeng Wang, Lijuan Wang, Jian Peng, Yu-Xiong Wang, Lei Zhang
  
  CVPR 2021 | June 2021
  
  Publication
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
  
  Linjie Li, Zhe Gan, Jingjing Liu
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication
- Large-Scale Adversarial Training for Vision-and-Language Representation Learning
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, JJ (Jingjing) Liu
  
  NeurIPS 2020 | December 2020
  
  PDF
- HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
  
  Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, Jingjing Liu
  
  Conf. on Empirical Methods in Natural Language Processing (EMNLP 2020) | November 2020
  
  Publication
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project
- Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
  
  Jize Cao, Zhe Gan, Yu Cheng, Licheng Yu, Yen-Chun Chen, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- UNITER: UNiversal Image-TExt Representation Learning
  
  Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  ECCV | October 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
  
  Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | June 2022
  
  Publication
- Scaling Up Vision-Language Pre-training for Image Captioning
  
  Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | March 2022
  
  Publication
- OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
  
  Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
  
  AAAI 2022 | February 2022
  
  Publication
- Playing Lottery Tickets with Vision and Language
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
  
  Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  NeurIPS 2021 | December 2021
  
  Publication
- VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
  
  Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
  
  arXiv preprint arXiv:2111.12681 | November 2021
  
  Publication
- UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  
  Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  arXiv preprint arXiv:2111.10023 | November 2021
  
  Publication
- Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
  
  Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu
  
  CVPR 2021 | June 2021
  
  CVPR 2021 Best Paper
  
  Publication Github
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
  
  Linjie Li, Zhe Gan, Jingjing Liu
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication

- LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
  
  Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | June 2022
  
  Published by Microsoft
  
  Publication
- GIT: A Generative Image-to-text Transformer for Vision and Language
  
  Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
  
  | May 2022
  
  Published by Microsoft
  
  Publication
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication
- REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
  
  Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
  
  Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
  
  Publication Publication
- UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  ECCV | October 2022
  
  Publication
- NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
  
  Chenfei Wu, Jian Liang, Xiaowei Hu, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
  
  NeurIPS 2022 | July 2022
  
  Publication
- An Empirical Study of Training End-to-End Vision-and-Language Transformers
  
  Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
  
  CVPR | June 2022
  
  Publication Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication
- SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
  
  Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | June 2022
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication
- Scaling Up Vision-Language Pre-training for Image Captioning
  
  Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  CVPR 2022 | March 2022
  
  Publication
- OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning
  
  Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA
  
  Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
  
  AAAI 2022 | February 2022
  
  Publication
- Playing Lottery Tickets with Vision and Language
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  AAAI 2022 | February 2022
  
  Publication
- VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
  
  Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
  
  NeurIPS 2021 | December 2021
  
  Publication
- Mesh Graphormer
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- End-to-End Semi-Supervised Object Detection with Soft Teacher
  
  Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models
  
  Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu
  
  ICCV 2021 | October 2021
  
  Publication
- Compressing Visual-Linguistic Model via Knowledge Distillation
  
  Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu
  
  ICCV 2021 | October 2021
  
  Publication
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication
- End-to-End Human Pose and Mesh Reconstruction with Transformers
  
  Kevin Lin, Lijuan Wang, Zicheng Liu
  
  CVPR 2021 | June 2021
  
  Publication
- Less is More: CLIPBERT for Video-and-Language Learning via Sparse Sampling
  
  Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu
  
  CVPR 2021 | June 2021
  
  CVPR 2021 Best Paper
  
  Publication Github
- TAP: Text-Aware Pre-training for Text-VQA and Text-Caption
  
  Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
  
  CVPR 2021 | June 2021
  
  Publication
- DAP: Detection-Aware Pre-training with Weak Supervision
  
  Yuanyi Zhong, Jianfeng Wang, Lijuan Wang, Jian Peng, Yu-Xiong Wang, Lei Zhang
  
  CVPR 2021 | June 2021
  
  Publication
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project
- Large-Scale Adversarial Training for Vision-and-Language Representation Learning
  
  Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, JJ (Jingjing) Liu
  
  NeurIPS 2020 | December 2020
  
  PDF
- HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training
  
  Linjie Li, Yen-Chun Chen, Yu Cheng, Zhe Gan, Licheng Yu, Jingjing Liu
  
  Conf. on Empirical Methods in Natural Language Processing (EMNLP 2020) | November 2020
  
  Publication
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project
- Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models
  
  Jize Cao, Zhe Gan, Yu Cheng, Licheng Yu, Yen-Chun Chen, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- UNITER: UNiversal Image-TExt Representation Learning
  
  Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, JJ (Jingjing) Liu
  
  ECCV 2020 | August 2020
  
  PDF
- MLP Architectures for Vision-and-Language Modeling: An Empirical Study
  
  Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
  
  December 2021
  
  Preprint
- VIOLET: End-to-End Video-Language Transformers with Masked Visual-token Modeling
  
  Tsu-Jui Fu, Linjie Li, Zhe Gan, Kevin Lin, William Yang Wang, Lijuan Wang, Zicheng Liu
  
  arXiv preprint arXiv:2111.12681 | November 2021
  
  Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication
- UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
  
  Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
  
  arXiv preprint arXiv:2111.10023 | November 2021
  
  Publication
- A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
  
  Linjie Li, Zhe Gan, Jingjing Liu
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication