Deep Learning Compiler and Optimizer

Publications

View by:

- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication
- NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
  
  Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
  
  2019 USENIX Annual Technical Conference | July 2019
  
  Publication Project
- Fast Distributed Deep Learning over RDMA
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
  
  EuroSys | March 2019
  
  Publication
- TuX2: Distributed Graph Computation for Machine Learning
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
  
  14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
  
  ISBN: 978-1-931971-37-9
  
  Publication Project

- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication
- NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
  
  Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
  
  2019 USENIX Annual Technical Conference | July 2019
  
  Publication Project
- Fast Distributed Deep Learning over RDMA
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
  
  EuroSys | March 2019
  
  Publication
- TuX2: Distributed Graph Computation for Machine Learning
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
  
  14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
  
  ISBN: 978-1-931971-37-9
  
  Publication Project
- NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
  
  Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
  
  2019 USENIX Annual Technical Conference | July 2019
  
  Publication Project

- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication
- NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
  
  Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
  
  2019 USENIX Annual Technical Conference | July 2019
  
  Publication Project
- Fast Distributed Deep Learning over RDMA
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
  
  EuroSys | March 2019
  
  Publication
- TuX2: Distributed Graph Computation for Machine Learning
  
  Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
  
  14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
  
  ISBN: 978-1-931971-37-9
  
  Publication Project

People

Youshan Miao

Senior Researcher

Learn more

Wei Cui

Principal Researcher

Learn more

Fan Yang

Sr. Principal Research Manager

Learn more

Lidong Zhou

Corporate Vice President, Chief Scientist of Microsoft Asia Pacific R&D Group, Managing Director of Microsoft Research Asia

Learn more