Vision and Language

Established: January 14, 2016

Publications

View by:

- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  Published by Microsoft
  
  Publication
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  Published by Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF
- Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
  
  Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
  
  The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
  
  Publication
- Learning Multimodal Attention LSTM Networks for Video Captioning
  
  Jun Xu, Ting Yao, Yongdong Zhang, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- Boosting Image Captioning with Attributes
  
  Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Tao Mei
  
  IEEE International Conference on Computer Vision (ICCV) | October 2017
  
  Publication
- To Create What You Tell: Generating Videos from Captions
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- Vision and Language: Bridging Vision and Language with Deep Learning
  
  Tao Mei, Jiebo Luo
  
  Tutorial of 2017 IEEE International Conference on Image Processing (ICIP) | September 2017
  
  Publication
- Seeing Bot
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  August 2017
  
  Publication
- Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects
  
  Ting Yao, Yingwei Pan, Yehao Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Multi-level Attention Networks for Visual Question Answering
  
  Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Video Captioning with Transferred Semantic Attributes
  
  Yingwei Pan, Ting Yao, Houqiang Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Tutorial on Bridging Video and Language with Deep Learning
  
  Tao Mei
  
  MSR-TR-2016-73 | October 2016
  
  Invited Tutorial in ECCV-ACM Multimedia 2016
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language [Supplementary Material]
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  October 2016
  
  Publication
- Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval
  
  Ting Yao, Fuchen Long, Tao Mei, Yong Rui
  
  International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
  
  Publication Project
- Jointly Modeling Embedding and Translation to Bridge Video and Language
  
  Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui
  
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | August 2016
  
  Publication
- Highlight Detection with Pairwise Deep Ranking for First-Person Video Summarization
  
  Ting Yao, Tao Mei, Yong Rui
  
  Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | June 2016
  
  Publication Publication Project
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  June 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Click-through-based Cross-view Learning for Image Search
  
  Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui
  
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2014
  
  Publication

- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  Published by Microsoft
  
  Publication
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  Published by Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication
- Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
  
  Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
  
  The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
  
  Publication
- Learning Multimodal Attention LSTM Networks for Video Captioning
  
  Jun Xu, Ting Yao, Yongdong Zhang, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- To Create What You Tell: Generating Videos from Captions
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- Boosting Image Captioning with Attributes
  
  Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Tao Mei
  
  IEEE International Conference on Computer Vision (ICCV) | October 2017
  
  Publication
- Vision and Language: Bridging Vision and Language with Deep Learning
  
  Tao Mei, Jiebo Luo
  
  Tutorial of 2017 IEEE International Conference on Image Processing (ICIP) | September 2017
  
  Publication
- Seeing Bot
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  August 2017
  
  Publication
- Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects
  
  Ting Yao, Yingwei Pan, Yehao Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Multi-level Attention Networks for Visual Question Answering
  
  Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Video Captioning with Transferred Semantic Attributes
  
  Yingwei Pan, Ting Yao, Houqiang Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Tutorial on Bridging Video and Language with Deep Learning
  
  Tao Mei
  
  MSR-TR-2016-73 | October 2016
  
  Invited Tutorial in ECCV-ACM Multimedia 2016
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language [Supplementary Material]
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  October 2016
  
  Publication
- Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval
  
  Ting Yao, Fuchen Long, Tao Mei, Yong Rui
  
  International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
  
  Publication Project
- Jointly Modeling Embedding and Translation to Bridge Video and Language
  
  Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui
  
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | August 2016
  
  Publication
- Highlight Detection with Pairwise Deep Ranking for First-Person Video Summarization
  
  Ting Yao, Tao Mei, Yong Rui
  
  Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | June 2016
  
  Publication Publication Project
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  June 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Click-through-based Cross-view Learning for Image Search
  
  Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui
  
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2014
  
  Publication
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF
- Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
  
  Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
  
  The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
  
  Publication
- Learning Multimodal Attention LSTM Networks for Video Captioning
  
  Jun Xu, Ting Yao, Yongdong Zhang, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- To Create What You Tell: Generating Videos from Captions
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- Boosting Image Captioning with Attributes
  
  Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Tao Mei
  
  IEEE International Conference on Computer Vision (ICCV) | October 2017
  
  Publication
- Vision and Language: Bridging Vision and Language with Deep Learning
  
  Tao Mei, Jiebo Luo
  
  Tutorial of 2017 IEEE International Conference on Image Processing (ICIP) | September 2017
  
  Publication
- Tutorial on Bridging Video and Language with Deep Learning
  
  Tao Mei
  
  MSR-TR-2016-73 | October 2016
  
  Invited Tutorial in ECCV-ACM Multimedia 2016
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language [Supplementary Material]
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  October 2016
  
  Publication
- Jointly Modeling Embedding and Translation to Bridge Video and Language
  
  Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui
  
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | August 2016
  
  Publication
- Highlight Detection with Pairwise Deep Ranking for First-Person Video Summarization
  
  Ting Yao, Tao Mei, Yong Rui
  
  Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | June 2016
  
  Publication Publication Project
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  June 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Click-through-based Cross-view Learning for Image Search
  
  Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui
  
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2014
  
  Publication
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  Published by Microsoft
  
  Publication
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  Published by Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF
- Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
  
  Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
  
  The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
  
  Publication
- Vision and Language: Bridging Vision and Language with Deep Learning
  
  Tao Mei, Jiebo Luo
  
  Tutorial of 2017 IEEE International Conference on Image Processing (ICIP) | September 2017
  
  Publication
- Seeing Bot
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  August 2017
  
  Publication
- Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects
  
  Ting Yao, Yingwei Pan, Yehao Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Multi-level Attention Networks for Visual Question Answering
  
  Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Video Captioning with Transferred Semantic Attributes
  
  Yingwei Pan, Ting Yao, Houqiang Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language [Supplementary Material]
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  October 2016
  
  Publication
- Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval
  
  Ting Yao, Fuchen Long, Tao Mei, Yong Rui
  
  International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
  
  Publication Project
- Jointly Modeling Embedding and Translation to Bridge Video and Language
  
  Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui
  
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | August 2016
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  June 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF
- Tutorial on Bridging Video and Language with Deep Learning
  
  Tao Mei
  
  MSR-TR-2016-73 | October 2016
  
  Invited Tutorial in ECCV-ACM Multimedia 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Click-through-based Cross-view Learning for Image Search
  
  Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui
  
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2014
  
  Publication

- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF
- Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
  
  Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
  
  The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
  
  Publication
- Learning Multimodal Attention LSTM Networks for Video Captioning
  
  Jun Xu, Ting Yao, Yongdong Zhang, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- To Create What You Tell: Generating Videos from Captions
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  ACM International Conference on Multimedia (ACM Multimedia) | October 2017
  
  Publication
- Boosting Image Captioning with Attributes
  
  Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Tao Mei
  
  IEEE International Conference on Computer Vision (ICCV) | October 2017
  
  Publication
- Vision and Language: Bridging Vision and Language with Deep Learning
  
  Tao Mei, Jiebo Luo
  
  Tutorial of 2017 IEEE International Conference on Image Processing (ICIP) | September 2017
  
  Publication
- Seeing Bot
  
  Yingwei Pan, Zhaofan Qiu, Ting Yao, Houqiang Li, Tao Mei
  
  August 2017
  
  Publication
- Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects
  
  Ting Yao, Yingwei Pan, Yehao Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Multi-level Attention Networks for Visual Question Answering
  
  Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- Video Captioning with Transferred Semantic Attributes
  
  Yingwei Pan, Ting Yao, Houqiang Li, Tao Mei
  
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
  
  Publication
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language [Supplementary Material]
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  October 2016
  
  Publication
- Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval
  
  Ting Yao, Fuchen Long, Tao Mei, Yong Rui
  
  International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
  
  Publication Project
- Jointly Modeling Embedding and Translation to Bridge Video and Language
  
  Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, Yong Rui
  
  IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | August 2016
  
  Publication
- Highlight Detection with Pairwise Deep Ranking for First-Person Video Summarization
  
  Ting Yao, Tao Mei, Yong Rui
  
  Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) | June 2016
  
  Publication Publication Project
- MSR-VTT: A Large Video Description Dataset for Bridging Video and Language
  
  Jun Xu, Tao Mei, Ting Yao, Yong Rui
  
  June 2016
  
  Publication
- Learning Query and Image Similarities with Ranking Canonical Correlation Analysis
  
  Ting Yao, Tao Mei, Chong-Wah Ngo
  
  December 2015
  
  Publication
- Click-through-based Cross-view Learning for Image Search
  
  Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui
  
  ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2014
  
  Publication
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  Published by Microsoft
  
  Publication
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  Published by Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication
- Tutorial on Bridging Video and Language with Deep Learning
  
  Tao Mei
  
  MSR-TR-2016-73 | October 2016
  
  Invited Tutorial in ECCV-ACM Multimedia 2016
  
  Publication

People

Jianlong Fu

Senior Research Manager

Learn more

Bei Liu

Senior Researcher

Learn more