Xiaofei Wang

Senior Researcher

Publications

View by:

- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication Project
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication Project
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication Project
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication Project
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication Project Project
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication Project
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication Project Project
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint Project
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication Project
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project

- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication Project
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication Project
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication Project
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication Project Project
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication Project Project
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication Project
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication Project
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication Project
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication Project Project
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication Project Project
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint Project
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication Project
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication Project
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication Project
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication Project
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication Project
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication Project
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication Project Project
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication Project Project
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint Project
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication Project
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project

- Investigating neural audio codecs for speech language model-based speech generation
  
  Jiaqi Li , Dongmei Wang, Xiaofei Wang, Yao Qian, Long Zhou, Shujie Liu, Midia Yousefi, Canrun Li , Chung-Hsien Tsai, Zhen Xiao, Yanqing Liu, Junkun Chen, Sheng Zhao, Jinyu Li, Zhizheng Wu , Michael Zeng
  
  SLT Workshop | December 2024
  
  Publication
- Laugh Now Cry Later: Controlling Time-Varying Emotional States of Flow-Matching-Based Zero-Shot Text-to-Speech
  
  Haibin Wu, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Daniel Tompkins, Chung-Hsien Tsai , Canrun Li, Zhen Xiao, Sheng Zhao , Jinyu Li, Naoyuki Kanda
  
  SLT Workshop | December 2024
  
  Publication
- An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
  
  Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
  
  Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
  
  Interspeech 2024 | September 2024
  
  Publication
- TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
  
  Chenyang Le, Yao Qian, Dongmei Wang, Long Zhou, Shujie Liu, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | May 2024
  
  Publication Project
- CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
  
  Leying Zhang, Yao Qian, Long Zhou, Shujie Liu (shujliu), Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
  
  NeurIPS 2024 | April 2024
  
  DOI Publication Project
- DiariST: Streaming Speech Translation with Speaker Diarization
  
  Mu Yang, Naoyuki Kanda, Xiaofei Wang, Junkun Chen, Peidong Wang, Jian Xue, Jinyu Li, Takuya Yoshioka
  
  ICASSP | April 2024
  
  Publication
- Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Streaming Multi-Talker ASR with Token-Level Serialized Output Training
  
  Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  Interspeech 2022 | September 2022
  
  Publication
- Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
  
  Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
  
  INTERSPEECH 2022 | September 2022
  
  Publication
- Personalized Speech Enhancement: New Models and Comprehensive Evaluation
  
  Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
  
  ICASSP 2022 | May 2022
  
  Publication
- Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
  
  Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
  
  ICASSP 2022 | May 2022
  
  Publication
- PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
  
  ICASSP 2022 | May 2022
  
  Publication Project
- VarArray: Array-Geometry-Agnostic Continuous Speech Separation
  
  Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
  
  ICASSP 2022 | May 2022
  
  Publication Project
- All-Neural Beamformer for Continuous Speech Separation
  
  Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
  
  ICASSP 2022 | May 2022
  
  Publication Project
- Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2022 | May 2022
  
  Publication Project Project
- A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
  
  Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  ASRU 2021 | December 2021
  
  Publication Project Project
- Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
  
  Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Preprint Project
- End-to-End Speaker-Attributed ASR with Transformer
  
  Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
  
  Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  Interspeech 2021 | August 2021
  
  Publication Project Project
- Continuous Speech Separation with Ad Hoc Microphone Arrays
  
  Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
  
  EUSIPCO | August 2021
  
  Publication Project
- Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
  
  Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
  
  Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
  
  ICASSP 2021 | June 2021
  
  Publication Project Project
- Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
  
  Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
  
  Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
  
  SLT 2021 | January 2021
  
  Publication Project Project
- Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- Serialized Output Training for End-to-End Overlapped Speech Recognition
  
  Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
  
  Interspeech 2020 | October 2020
  
  Publication Project Project
- SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
  
  Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
  
  August 2023
  
  Publication
- Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
  
  Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
  
  arXiv:2211.05564 | November 2022
  
  Publication
- Speech separation with large-scale self-supervised learning
  
  Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
  
  arXiv:2211.05172 | November 2022
  
  Publication
- Breaking trade-offs in speech separation with sparsely-gated mixture of experts
  
  Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
  
  arXiv:2211.06493 | November 2022
  
  Preprint
- Simulating realistic speech overlaps improves multi-talker ASR
  
  Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2210.15715 | October 2022
  
  Publication
- VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
  
  Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
  
  arXiv:2209.04974 | September 2022
  
  Publication