Noel Codella

Principal Researcher

Publications

View by:

- Exploring Scalable Medical Image Encoders Beyond Text Supervision
  
  Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay
  
  Nature Machine Intelligence | January 2025, Vol 7: pp. 119-130
  
  Publication DOI Download Project
- MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
  
  Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei
  
  October 2024
  
  Publication
- 3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology
  
  Asma Ben Abacha, Alberto Santamaria-Pang, Ho Hin Lee, Jameson Merkow, Qin Cai, Surya Teja Devarakonda, Abdullah Islam, Julia Gong, Matthew P Lungren, Thomas Lin, Noel Codella, Ivan Tarapov
  
  arXiv:2311.13752 | November 2023
  
  Publication
- MAIRA-1: A specialised large multimodal model for radiology report generation
  
  Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle
  
  MSR-TR-2023-47 | November 2023
  
  Published by Microsoft
  
  Publication Project
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
  
  Haoxuan You, Luowei Zhou, Bin Xiao, Noel Codella, Yu Cheng, Ruochen Xu, Shih-Fu Chang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Publication
- DaViT: Dual Attention Vision Transformers
  
  Mingyu Ding, Bin Xiao, Noel Codella, Ping Luo, Jingdong Wang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Preprint
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: the 2019 International Skin Imaging Collaboration Grand Challenge
  
  Marc Combalia, Noel Codella, Veronica Rotemberg, Cristina Carrera, Stephen Dusza, David Gutman
  
  The Lancet Digital Health | May 2022, Vol 4(5)
  
  Publication Publication
- Checklist for Evaluation of Image-Based Artificial Intelligence Reports in Dermatology: CLEAR Derm Consensus Guidelines From the International Skin Imaging Collaboration Artificial Intelligence Working Group
  
  Catarina Barata, Brigid Betz-Stablein, M Emre Celebi, Noel Codella, Marc Combalia, Pascale Guitera, David Gutman, Allan Halpern, Brian Helba, Harald Kittler, Kivanc Kose, Konstantinos Liopyris, Josep Malvehy, Han Seung Seog, H Peter Soyer, Eric R Tkaczyk, Philipp Tschandl, Veronica Rotemberg
  
  JAMA Dermatology | November 2021
  
  DOI Publication Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- CvT: Introducing Convolutions to Vision Transformers
  
  Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang
  
  ICCV 2021 | March 2021
  
  Publication

- Exploring Scalable Medical Image Encoders Beyond Text Supervision
  
  Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay
  
  Nature Machine Intelligence | January 2025, Vol 7: pp. 119-130
  
  Publication DOI Download Project
- MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
  
  Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei
  
  October 2024
  
  Publication
- 3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology
  
  Asma Ben Abacha, Alberto Santamaria-Pang, Ho Hin Lee, Jameson Merkow, Qin Cai, Surya Teja Devarakonda, Abdullah Islam, Julia Gong, Matthew P Lungren, Thomas Lin, Noel Codella, Ivan Tarapov
  
  arXiv:2311.13752 | November 2023
  
  Publication
- MAIRA-1: A specialised large multimodal model for radiology report generation
  
  Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle
  
  MSR-TR-2023-47 | November 2023
  
  Published by Microsoft
  
  Publication Project
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
  
  Haoxuan You, Luowei Zhou, Bin Xiao, Noel Codella, Yu Cheng, Ruochen Xu, Shih-Fu Chang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Publication
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: the 2019 International Skin Imaging Collaboration Grand Challenge
  
  Marc Combalia, Noel Codella, Veronica Rotemberg, Cristina Carrera, Stephen Dusza, David Gutman
  
  The Lancet Digital Health | May 2022, Vol 4(5)
  
  Publication Publication
- Checklist for Evaluation of Image-Based Artificial Intelligence Reports in Dermatology: CLEAR Derm Consensus Guidelines From the International Skin Imaging Collaboration Artificial Intelligence Working Group
  
  Catarina Barata, Brigid Betz-Stablein, M Emre Celebi, Noel Codella, Marc Combalia, Pascale Guitera, David Gutman, Allan Halpern, Brian Helba, Harald Kittler, Kivanc Kose, Konstantinos Liopyris, Josep Malvehy, Han Seung Seog, H Peter Soyer, Eric R Tkaczyk, Philipp Tschandl, Veronica Rotemberg
  
  JAMA Dermatology | November 2021
  
  DOI Publication Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- CvT: Introducing Convolutions to Vision Transformers
  
  Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang
  
  ICCV 2021 | March 2021
  
  Publication
- Exploring Scalable Medical Image Encoders Beyond Text Supervision
  
  Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay
  
  Nature Machine Intelligence | January 2025, Vol 7: pp. 119-130
  
  Publication DOI Download Project
- MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
  
  Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei
  
  October 2024
  
  Publication
- 3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology
  
  Asma Ben Abacha, Alberto Santamaria-Pang, Ho Hin Lee, Jameson Merkow, Qin Cai, Surya Teja Devarakonda, Abdullah Islam, Julia Gong, Matthew P Lungren, Thomas Lin, Noel Codella, Ivan Tarapov
  
  arXiv:2311.13752 | November 2023
  
  Publication
- MAIRA-1: A specialised large multimodal model for radiology report generation
  
  Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle
  
  MSR-TR-2023-47 | November 2023
  
  Published by Microsoft
  
  Publication Project
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
  
  Haoxuan You, Luowei Zhou, Bin Xiao, Noel Codella, Yu Cheng, Ruochen Xu, Shih-Fu Chang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Publication
- DaViT: Dual Attention Vision Transformers
  
  Mingyu Ding, Bin Xiao, Noel Codella, Ping Luo, Jingdong Wang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Preprint
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- CvT: Introducing Convolutions to Vision Transformers
  
  Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang
  
  ICCV 2021 | March 2021
  
  Publication
- Exploring Scalable Medical Image Encoders Beyond Text Supervision
  
  Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay
  
  Nature Machine Intelligence | January 2025, Vol 7: pp. 119-130
  
  Publication DOI Download Project
- MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
  
  Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei
  
  October 2024
  
  Publication
- 3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology
  
  Asma Ben Abacha, Alberto Santamaria-Pang, Ho Hin Lee, Jameson Merkow, Qin Cai, Surya Teja Devarakonda, Abdullah Islam, Julia Gong, Matthew P Lungren, Thomas Lin, Noel Codella, Ivan Tarapov
  
  arXiv:2311.13752 | November 2023
  
  Publication
- Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: the 2019 International Skin Imaging Collaboration Grand Challenge
  
  Marc Combalia, Noel Codella, Veronica Rotemberg, Cristina Carrera, Stephen Dusza, David Gutman
  
  The Lancet Digital Health | May 2022, Vol 4(5)
  
  Publication Publication
- Checklist for Evaluation of Image-Based Artificial Intelligence Reports in Dermatology: CLEAR Derm Consensus Guidelines From the International Skin Imaging Collaboration Artificial Intelligence Working Group
  
  Catarina Barata, Brigid Betz-Stablein, M Emre Celebi, Noel Codella, Marc Combalia, Pascale Guitera, David Gutman, Allan Halpern, Brian Helba, Harald Kittler, Kivanc Kose, Konstantinos Liopyris, Josep Malvehy, Han Seung Seog, H Peter Soyer, Eric R Tkaczyk, Philipp Tschandl, Veronica Rotemberg
  
  JAMA Dermatology | November 2021
  
  DOI Publication Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
  
  Haoxuan You, Luowei Zhou, Bin Xiao, Noel Codella, Yu Cheng, Ruochen Xu, Shih-Fu Chang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Publication

- Exploring Scalable Medical Image Encoders Beyond Text Supervision
  
  Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel Coelho de Castro, Anton Schwaighofer, Matthew P Lungren, Noel Codella, Stephanie Hyland, Javier Alvarez-Valle, Ozan Oktay
  
  Nature Machine Intelligence | January 2025, Vol 7: pp. 119-130
  
  Publication DOI Download Project
- 3D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiology
  
  Asma Ben Abacha, Alberto Santamaria-Pang, Ho Hin Lee, Jameson Merkow, Qin Cai, Surya Teja Devarakonda, Abdullah Islam, Julia Gong, Matthew P Lungren, Thomas Lin, Noel Codella, Ivan Tarapov
  
  arXiv:2311.13752 | November 2023
  
  Publication
- Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: the 2019 International Skin Imaging Collaboration Grand Challenge
  
  Marc Combalia, Noel Codella, Veronica Rotemberg, Cristina Carrera, Stephen Dusza, David Gutman
  
  The Lancet Digital Health | May 2022, Vol 4(5)
  
  Publication Publication
- Checklist for Evaluation of Image-Based Artificial Intelligence Reports in Dermatology: CLEAR Derm Consensus Guidelines From the International Skin Imaging Collaboration Artificial Intelligence Working Group
  
  Catarina Barata, Brigid Betz-Stablein, M Emre Celebi, Noel Codella, Marc Combalia, Pascale Guitera, David Gutman, Allan Halpern, Brian Helba, Harald Kittler, Kivanc Kose, Konstantinos Liopyris, Josep Malvehy, Han Seung Seog, H Peter Soyer, Eric R Tkaczyk, Philipp Tschandl, Veronica Rotemberg
  
  JAMA Dermatology | November 2021
  
  DOI Publication Publication
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
  
  Noel Codella, Yu Gu, Shrey Jain, Ho Hin Lee, Asma Ben Abacha, Alberto Santamaria-Pang, Will Guyman, Natieek Sangani, Sheng Zhang, Hoifung Poon, Stephanie Hyland, Shruthi Bannur, Javier Alvarez-Valle, Xue Li, John Garett, Alan McMillan, Gaurav Rajguru, Madhu Maddi, Nilesh Vijayrania, Reehan Bhimai, Nick Mecklenburg, Rupal Jain, Daniel Holstein, Naveen Gaur, Vijay Aski, Jenq-Neng Hwang, Thomas Lin, Ivan Tarapov, Matthew P Lungren, Mu Wei
  
  October 2024
  
  Publication
- MAIRA-1: A specialised large multimodal model for radiology report generation
  
  Stephanie Hyland, Shruthi Bannur, Kenza Bouzid, Daniel Coelho de Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle
  
  MSR-TR-2023-47 | November 2023
  
  Published by Microsoft
  
  Publication Project
- i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
  
  Ziyi Yang, Mahmoud Khademi, Yichong Xu, Reid Pryzant, Yuwei Fang, Chenguang Zhu, Dongdong Chen, Yao Qian, Mei Gao, Yi-Ling Chen, Robert Gmyr, Naoyuki Kanda, Noel Codella, Bin Xiao, Yu Shi, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
  
  North American Chapter of the Association for Computational Linguistics (NAACL) 2024 | May 2023
  
  Publication
- Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training
  
  Haoxuan You, Luowei Zhou, Bin Xiao, Noel Codella, Yu Cheng, Ruochen Xu, Shih-Fu Chang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Publication
- DaViT: Dual Attention Vision Transformers
  
  Mingyu Ding, Bin Xiao, Noel Codella, Ping Luo, Jingdong Wang, Lu Yuan
  
  European Conference on Computer Vision (ECCV 2022) | October 2022
  
  Preprint
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- CvT: Introducing Convolutions to Vision Transformers
  
  Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang
  
  ICCV 2021 | March 2021
  
  Publication