Optimizing Large Language Model Training Using FP4 Quantization
Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
ICML 2025 | January 2025
Ziyue Yang
Senior Researcher
Papiers de Collaboration
-
-
-
-
SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation
Yifan Xiong, Yuting Jiang, Ziyue Yang, Lei Qu, Guoshuai Zhao, Shuguang Liu, Dong Zhong, Boris Pinzur, Jie Zhang, Yang Wang, Jithin Jose, Hossein Pourreza, Jeff Baxter, Kushal Datta, Prabhat Ram, Luke Melton, Joe Chau, Peng Cheng, Yongqiang Xiong, Lidong Zhou
USENIX ATC | July 2024
Best Paper Award
-
-
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
-
-
Tutel: Adaptive Mixture-of-Experts at Scale
Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
July 2022
-
-
-
Towards User-Defined SLA in Cloud Flash Storage
Jinhao Fan, Ziyue Yang, Ran Shu, Peng Cheng, Yongqiang Xiong
The 12th ACM SIGOPS Asia-Pacific Workshop on Systems | August 2021
-
-
-
Optimizing Large Language Model Training Using FP4 Quantization
Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
ICML 2025 | January 2025
-
-
-
SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation
Yifan Xiong, Yuting Jiang, Ziyue Yang, Lei Qu, Guoshuai Zhao, Shuguang Liu, Dong Zhong, Boris Pinzur, Jie Zhang, Yang Wang, Jithin Jose, Hossein Pourreza, Jeff Baxter, Kushal Datta, Prabhat Ram, Luke Melton, Joe Chau, Peng Cheng, Yongqiang Xiong, Lidong Zhou
USENIX ATC | July 2024
Best Paper Award
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
Tutel: Adaptive Mixture-of-Experts at Scale
Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
July 2022
-
Towards User-Defined SLA in Cloud Flash Storage
Jinhao Fan, Ziyue Yang, Ran Shu, Peng Cheng, Yongqiang Xiong
The 12th ACM SIGOPS Asia-Pacific Workshop on Systems | August 2021
-
-
-
Optimizing Large Language Model Training Using FP4 Quantization
Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
ICML 2025 | January 2025
-
SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation
Yifan Xiong, Yuting Jiang, Ziyue Yang, Lei Qu, Guoshuai Zhao, Shuguang Liu, Dong Zhong, Boris Pinzur, Jie Zhang, Yang Wang, Jithin Jose, Hossein Pourreza, Jeff Baxter, Kushal Datta, Prabhat Ram, Luke Melton, Joe Chau, Peng Cheng, Yongqiang Xiong, Lidong Zhou
USENIX ATC | July 2024
Best Paper Award
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
Tutel: Adaptive Mixture-of-Experts at Scale
Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
July 2022
-
Towards User-Defined SLA in Cloud Flash Storage
Jinhao Fan, Ziyue Yang, Ran Shu, Peng Cheng, Yongqiang Xiong
The 12th ACM SIGOPS Asia-Pacific Workshop on Systems | August 2021
-