LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
Mao Yang
Assistant Managing Director
Papiers de Collaboration
-
-
-
PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
OSDI | July 2025
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
FlashFFTStencil: Bridging Fast Fourier Transforms to Memory-Efficient Stencil Computations on Tensor Core Units
Haozhi Han, Kun Li, Wei Cui, Donglin Bai, Yiwei Zhang, Liang Yuan, Yifeng Chen, Yunquan Zhang, Ting Cao, Mao Yang
ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) | March 2025
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
-
-
REDSTONE: Curating General, Code, Math, and QA Data for Large Language Models
Yaoyao Chang, Lei Cui, Li Dong, Shaohan Huang, Yangyu Huang, Yupan Huang, Scarlett Li, Tengchao Lv, Shuming Ma, Qinzheng Sun, Wenhui Wang, Furu Wei, Ying Xin, Mao Yang, Qiufeng Yin, Xingxing Zhang
December 2024
-
Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
October 2024
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
August 2024
-
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
-
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
-
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
-
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
-
T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge
Jianyu Wei, Shijie Cao, Ting Cao, Lingxiao Ma, Lei Wang, Yanyong Zhang, Mao Yang
June 2024
-
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
-
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
-
-
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
-
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
-
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
-
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
-
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Publié par Microsoft
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Publié par Microsoft
-
-
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
-
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Publié par Microsoft
-
-
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Publié par Microsoft
-
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
-
-
-
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Publié par Microsoft
-
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
-
-
-
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
-
-
-
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
-
-
-
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
-
-
-
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
-
-
-
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
-
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
-
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
-
-
-
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
-
-
-
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
-
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007
-
-
-
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
-
-
-
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
-
-
-
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
-
-
-
PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
OSDI | July 2025
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
FlashFFTStencil: Bridging Fast Fourier Transforms to Memory-Efficient Stencil Computations on Tensor Core Units
Haozhi Han, Kun Li, Wei Cui, Donglin Bai, Yiwei Zhang, Liang Yuan, Yifeng Chen, Yunquan Zhang, Ting Cao, Mao Yang
ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) | March 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
-
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
October 2024
-
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
-
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
-
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
-
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
-
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
-
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
-
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
-
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Publié par Microsoft
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Publié par Microsoft
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
-
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Publié par Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Publié par Microsoft
-
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
-
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Publié par Microsoft
-
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
-
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
-
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
-
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
-
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
-
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
-
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
-
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
-
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007
-
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
-
-
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
August 2024
-
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
-
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
-
T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge
Jianyu Wei, Shijie Cao, Ting Cao, Lingxiao Ma, Lei Wang, Yanyong Zhang, Mao Yang
June 2024
-
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Publié par Microsoft
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Publié par Microsoft
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Publié par Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Publié par Microsoft
-
-
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Publié par Microsoft
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Publié par Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Publié par Microsoft
-
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Publié par Microsoft
-
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
-
-
-
FlashFFTStencil: Bridging Fast Fourier Transforms to Memory-Efficient Stencil Computations on Tensor Core Units
Haozhi Han, Kun Li, Wei Cui, Donglin Bai, Yiwei Zhang, Liang Yuan, Yifeng Chen, Yunquan Zhang, Ting Cao, Mao Yang
ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) | March 2025
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
-
-
REDSTONE: Curating General, Code, Math, and QA Data for Large Language Models
Yaoyao Chang, Lei Cui, Li Dong, Shaohan Huang, Yangyu Huang, Yupan Huang, Scarlett Li, Tengchao Lv, Shuming Ma, Qinzheng Sun, Wenhui Wang, Furu Wei, Ying Xin, Mao Yang, Qiufeng Yin, Xingxing Zhang
December 2024
-
-
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
-
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
-
-
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
-
-
-
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
-
-
-
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
-
-
-
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
-
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
-
-
-
PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
OSDI | July 2025
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
Reduction Fusion for Optimized Distributed Data-Parallel Computations via Inverse Recomputation
Haoxiang Lin, Yang Wang, Yanjie Gao, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Ideas, Visions and Reflections Track
-
dl²: Detecting Communication Deadlocks in Deep Learning Jobs
Yanjie Gao, Jiyu Luo, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
FSE 2025 | June 2025
The ACM International Conference on the Foundations of Software Engineering, Industry Track
-
FlashFFTStencil: Bridging Fast Fourier Transforms to Memory-Efficient Stencil Computations on Tensor Core Units
Haozhi Han, Kun Li, Wei Cui, Donglin Bai, Yiwei Zhang, Liang Yuan, Yifeng Chen, Yunquan Zhang, Ting Cao, Mao Yang
ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) | March 2025
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
SOSP | November 2024
-
IRGen: Generative Modeling for Image Retrieval
Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
ECCV'24 | October 2024
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
OSDI | July 2024
-
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
-
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
ISCA 2024 | July 2024
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
-
Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024
-
MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
2024 The Web Conference | May 2024
-
OneSparse: A Unified System for Multi-index Vector Search
Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
2024 The Web Conference | May 2024
-
An Empirical Study on Low GPU Utilization of Deep Learning Jobs
Yanjie Gao, Yichen He, Xinze Li, Bo Zhao, Haoxiang Lin, Yoyo Liang, Jing Zhong, Hongyu Zhang, Jingzhou Wang, Yonghua Zeng, Keli Gui, Jie Tong, Mao Yang
ICSE 2024 | April 2024
The 46th International Conference on Software Engineering
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
-
ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
Best paper award
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
SOSP'23 | October 2023
Microsoft Research Blog
https://www.rarnonalumber.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
-
PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
The 29th ACM Symposium on Operating Systems Principles | October 2023
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
OSDI'23 | July 2023
-
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
-
NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
An Empirical Study on Quality Issues of Deep Learning Platform
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, Mao Yang
ICSE 2023 | May 2023
The 45th International Conference on Software Engineering, Software Engineering in Practice (SEIP) Track
-
FrozenHot Cache: Rethinking Cache Management for Modern Hardware
Ziyue Qiu, Juncheng Yang, Juncheng Zhang, Cheng Li, Xiaosong Ma, Qi Chen, Mao Yang, Yinlong Xu
EuroSys'23 | May 2023
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
A Neural Corpus Indexer for Document Retrieval
Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Qi Chen, Yuqing Xia, Chengmin Chi, Guoshuai Zhao, Zheng Liu, Xing Xie, Hao Allen Sun, Weiwei Deng, Qi Zhang, Mao Yang
NeurIPS 2022 | November 2022
Outstanding Paper
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
OSDI 2022 | July 2022
-
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
-
Refty: Refinement Types for Valid Deep Learning Models
Yanjie Gao, Zhengxian Li, Haoxiang Lin, Hongyu Zhang, Ming Wu, Mao Yang
ICSE 2022 | May 2022
The 44th International Conference on Software Engineering
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
Qi Chen, Bing Zhao, Haidong Wang, Mingqin Li, Chuanjie Liu, Zengzhong Li, Mao Yang, Jingdong Wang, Mao Yang, Jingdong Wang
NeurIPS 2021 | November 2021
Spotlight presentation, Microsoft News: https://news.microsoft.com/source/features/innovation/bing-vector-search/
-
Argus: A Fully Transparent Incentive System for Anti-Piracy Campaigns
Xian Zhang, Xiaobing Guo, Zixuan Zeng, Wenyan Liu, Zhongxin Guo, Yang Chen, Shuo Chen, Qiufeng Yin, Mao Yang
The 40th International Symposium on Reliable Distributed Systems (SRDS) | September 2021
-
Resource-Guided Configuration Space Reduction for Deep Learning Models
Yanjie Gao, Yonghao Zhu, Hongyu Zhang, Haoxiang Lin, Mao Yang
ICSE 2021 | May 2021
The 43rd International Conference on Software Engineering
-
OpEvo: An Evolutionary Method for Tensor Operator Optimization
Xiaotian Gao, Wei Cui, Lintao Zhang, Mao Yang
AAAI 2021 | May 2021
-
Match Plan Generation in Web Search with Parameterized Action Reinforcement Learning
Ziyan Luo, Linfeng Zhao, Wei Cheng, Sihao Chen, Qi Chen, Hui Xue, Haidong Wang, Chuanjie Liu, Mao Yang, Lintao Zhang
2021 The Web Conference | April 2021
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
ESEC/FSE 2020 | November 2020
The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, Industry Track
-
HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
2020 Operating Systems Design and Implementation | November 2020
-
Retiarii: A Deep Learning Exploratory-Training Framework
Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
2020 Operating Systems Design and Implementation | November 2020
-
An Empirical Study on Program Failures of Deep Learning Jobs
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, Mao Yang
ICSE 2020 | July 2020
ACM SIGSOFT Distinguished Paper Award
The 42nd International Conference on Software Engineering
-
AutoSys: The Design and Operation of Learning-Augmented Systems
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou, Lifei Zhu, Zhao Lucis Li, Zibo Wang, Qi Chen, Quanlu Zhang, Chuanjie Liu, Wenjun Dai
ATC (USENIX Annual Technical Conference) | July 2020
-
Rex: Replication at the Speed of Multi-core
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
EuroSys '14: Proceedings of the Ninth European Conference on Computer Systems | January 2014
-
Failure Recovery: When the Cure Is Worse Than the Disease
Zhenyu Guo, Sean McDirmid, Mao Yang, Li Zhuang, Pu Zhang, Yingwei Luo, Tom Bergan, Peter Bodík, Madan Musuvathi, Zheng Zhang, Lidong Zhou
HotOS | May 2013
HotOS
-
G2: A Graph Processing System for Diagnosing Distributed Systems
Zhenyu Guo, Dong Zhou, Haoxiang Lin, Mao Yang, Fan Long, Chaoqiang Deng, Changshu Liu, Lidong Zhou
USENIX ATC 2011 | June 2011
The 2011 USENIX Annual Technical Conference
-
MODIST: Transparent Model Checking of Unmodified Distributed Systems
Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, Lidong Zhou
NSDI 2009 | April 2009
The 6th Symposium on Networked Systems Design and Implementation
-
Wave Computing in the Cloud
Mao Yang, Zhenyu Guo, Wei Lin, Bing Su, Lidong Zhou, Saven He
HotOS | April 2009
-
A Multi-dimensional Reputation System Combined with Trust and Incentive Mechanisms in P2P File Sharing Systems
Mao Yang, Qinyuan Feng, Yafei Dai, Zheng Zhang
June 2007
-
Robust Incentives via Multi-level Tit-for-tat
Qiao Lian, Peng Yu, Mao Yang, Zheng Zhang, Yafei Dai, Xiaoming Li, Roger (Peng) Yu
February 2006
-
An Empirical Study of Free-Riding Behavior in the Maze P2P File-Sharing System
Mao Yang, Zhengyou Zhang
February 2005
-
Deployment of a Large-scale Peer-to-Peer Social Network
Mao Yang, Hua Chen, Ben Y. Zhao, Yafei Dai, Zhengyou Zhang
USENIX | December 2004
-
-
-
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
October 2024
-
LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
August 2024
-
T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge
Jianyu Wei, Shijie Cao, Ting Cao, Lingxiao Ma, Lei Wang, Yanyong Zhang, Mao Yang
June 2024
-
-
-
REDSTONE: Curating General, Code, Math, and QA Data for Large Language Models
Yaoyao Chang, Lei Cui, Li Dong, Shaohan Huang, Yangyu Huang, Yupan Huang, Scarlett Li, Tengchao Lv, Shuming Ma, Qinzheng Sun, Wenhui Wang, Furu Wei, Ying Xin, Mao Yang, Qiufeng Yin, Xingxing Zhang
December 2024
-
Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
September 2024
-
-
-
LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data
Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu
Neural Networks | August 2024
-
The Case for Learning-and-System Co-design
Chieh-Jan Mike Liang, Hui Xue, Mao Yang, Lidong Zhou
ACM SIGOPS Operating Systems Review | July 2019, Vol 53(1): pp. 68-74
-
-
-
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
MSR-TR-2021-20 | August 2021
Publié par Microsoft
-
Runtime Performance Prediction for Deep Learning Models with Graph Neural Network (Tech Report)
Yanjie Gao, Xianyu Gu, Hongyu Zhang, Haoxiang Lin, Mao Yang
MSR-TR-2021-3 | February 2021
Publié par Microsoft
-
Estimating GPU Memory Consumption of Deep Learning Models
Yanjie Gao, Yu Liu, Hongyu Zhang, Zhengxian Li, Yonghao Zhu, Haoxiang Lin, Mao Yang
MSR-TR-2020-20 | May 2020
Publié par Microsoft
-
Enhancing the Interoperability between Deep Learning Frameworks by Model Conversion
Yu Liu, Cheng Chen, Ru Zhang, Tingting Qin, Xiang Ji, Haoxiang Lin, Mao Yang
MSR-TR-2019-36 | November 2019
Publié par Microsoft
-
Arming Cloud Services with Task Aspects
Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
MSR-TR-2014-150 | November 2014
Publié par Microsoft
-
Paxos Made Parallel
Zhenyu Guo, Chuntao Hong, Mao Yang, Dong Zhou, Lidong Zhou, Li Zhuang
MSR-TR-2012-118 | November 2012
-
On the Efficiency and Programmability of Large Graph Processing in the Cloud
Rishan Chen, Xuetian Weng, Bingsheng He, Mao Yang, Byron Choi, Xiaoming Li
MSR-TR-2010-44 | May 2010
-
Comet: Batched Stream Processing in Data Intensive Distributed Computing
Bingsheng He, Mao Yang, Zhenyu Guo, Rishan Chen, Bing Su, Wei Lin, Lidong Zhou
MSR-TR-2009-180 | December 2009
-
PacificA: Replication in Log-Based Distributed Storage Systems
Wei Lin, Mao Yang, Lintao Zhang, Lidong Zhou
MSR-TR-2008-25 | February 2008
-
An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System
Qiao Lian, Zheng Zhang, Mao Yang, Ben Y. Zhao, Yafei Dai, Xiaoming Li
MSR-TR-2006-14 | June 2007
-