Heterogeneous Extreme Computing (HEX) Group

论文与出版物

查看方式：

- FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices
  
  Xiangyu Li, Yuanchun Li, Yuanzhe Li, Ting Cao, Yunxin Liu
  
  International Conference on Mobile Computing and Networking (MobiCom ’24) | November 2024
  
  Publication
- Anatomizing Deep Learning Inference in Web Browsers
  
  Qipeng Wang, Shiqi Jiang, Zhenpeng Chen, Xu Cao, Yuanchun Li, Aoyu Li, Yun Ma, Ting Cao, Xuanzhe Liu
  
  ACM Transactions on Software Engineering and Methodology | August 2024
  
  Publication
- Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
  
  Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
  
  ISCA 2024 | July 2024
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
  
  Publication
- Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
  
  Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
  
  the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024
  
  Publication
- Autodroid: LLM-Powered Task Automation in Android
  
  Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu
  
  the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024
  
  Publication
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
  
  Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
  
  29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’24) | April 2024
  
  Publication
- ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
  
  Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
  
  The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
  
  Best paper award
  
  Publication
- Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning
  
  Ya Nan, Shiqi Jiang, Mo Li
  
  ACM Transactions on Sensor Network | October 2023, 第 20 卷(1): pp. 1-23
  
  Publication
- LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
  
  Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23) | October 2023
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
  
  Publication 项目
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar Operations
  
  Chen Nie, Chenyu Tang, Jie Lin, Huan Hu, Chenyang Lv, Ting Cao, Weifeng Zhang, Li Jiang, Xiaoyao Liang, Weikang Qian, Yanan Sun, Zhezhi He
  
  IEEE Transactions on Computers | June 2023
  
  Publication
- Boosting DNN Cold Inference on Devices
  
  Rongjie Yi, Ting Cao, Ao Zhou, Xiao Ma, Shangguang Wang, Mengwei Xu
  
  The 21st Annual International Conference on Mobile Systems, Applications and Services (MobiSys ’23) | June 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023
  
  Publication 项目
- NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
  
  Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
  
  The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
  
  Publication
- AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments
  
  Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- The Case for Learning Machine Language
  
  Guangda Liu, Chieh-Jan Mike Liang, Shijie Cao, Shuai Lu, Leendert van Doorn
  
  ML for Systems at NeurIPS | December 2022
  
  Publication
- Hyperion: A Generic and Distributed Mobile Offloading Framework on OpenCL
  
  Ziyan Fu, Ju Ren, Yunxin Liu, Ting Cao, Deyu Zhang, Yuezhi Zhou, Yaoxue Zhang
  
  ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- Turbo: Opportunistic Enhancement for Edge Video Analytics
  
  Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu
  
  The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- MobiDepth: Real-Time Depth Estimation Using On-Device Dual Cameras
  
  Jinrui Zhang, Huan Yang, Ju Ren, Deyu Zhang, Bangwen He, Yuanchun Li, Ting Cao, Yaoxue Zhang, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | October 2022
  
  Publication
- SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
  
  Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
  
  ACM International Conference on Information and Knowledge Management (CIKM’22) | October 2022
  
  Publication
- CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices
  
  Fucheng Jia, Deyu Zhang, Ting Cao, Shiqi Jiang, Yunxin Liu, Ju Ren, Yaoxue Zhang
  
  Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (MobiSys’22) | June 2022
  
  Publication
- Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
  
  Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
  
  HotMobile’22 | March 2022
  
  Publication
- Romou: Rapidly Generate High-Performance Tensor Kernels for Mobile GPUs
  
  Rendong Liang, Ting Cao, Jicheng Wen, Manni Wang, Yang Wang, Jianhua Zou, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | February 2022
  
  2023 Top 100 Open Source Achievement Award
  
  Publication
- nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
  
  Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
  
  GetMobile: Mobile Computing and Communications | December 2021, 第 25 卷(4): pp. 19-23
  
  SigMobile Research Highlight
  
  Publication
- Unified Holistic Memory Management Supporting Multiple Big Data Processing Frameworks over Hybrid Memories
  
  Lei Chen, Jiacheng Zhao, Chenxi Wang, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu, Huimin Cui
  
  ACM Transactions on Computer Systems | November 2021, 第 39 卷(1-4): pp. 1-38
  
  Publication
- AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs
  
  Manni Wang, Shaohua Ding, Ting Cao, Yunxin Liu, Fengyuan Xu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom’21) | October 2021
  
  Publication 项目
- Boosting Mobile CNN Inference through Semantic Memory
  
  Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
  
  Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
  
  Publication
- Flexible High-resolution Object Detection on Edge Devices with Tunable Latency
  
  Shiqi Jiang, Zhiqi Lin, Yuanchun Li, Yuanchao Shu, Yunxin Liu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom ’21)) | October 2021
  
  Publication
- AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
  
  Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
  
  August 2021
  
  发布者： arXiv | August 2021
  
  Publication
- To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
  
  Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
  
  MLSys | April 2021
  
  Publication
- Profiling and optimizing deep learning inference on mobile GPUs
  
  Shiqi Jiang, Lihao Ran, Ting Cao, Yusen Xu, Yunxin Liu
  
  Proceedings of the 11th ACM SIGOPS Asia-Pacific Workshop on Systems (APSys ’20) | August 2020
  
  Publication
- Fast Hardware-Aware Neural Architecture Search
  
  Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
  
  CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
  
  DOI PDF Publication
- Panthera: Holistic Memory Management for Big Data Processing over Hybrid Memories
  
  Chenxi Wang, Huimin Cui, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu
  
  the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’19) | June 2019
  
  Publication

- Anatomizing Deep Learning Inference in Web Browsers
  
  Qipeng Wang, Shiqi Jiang, Zhenpeng Chen, Xu Cao, Yuanchun Li, Aoyu Li, Yun Ma, Ting Cao, Xuanzhe Liu
  
  ACM Transactions on Software Engineering and Methodology | August 2024
  
  Publication
- Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
  
  Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
  
  the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024
  
  Publication
- Autodroid: LLM-Powered Task Automation in Android
  
  Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu
  
  the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024
  
  Publication
- Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning
  
  Ya Nan, Shiqi Jiang, Mo Li
  
  ACM Transactions on Sensor Network | October 2023, 第 20 卷(1): pp. 1-23
  
  Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments
  
  Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023
  
  Publication
- Hyperion: A Generic and Distributed Mobile Offloading Framework on OpenCL
  
  Ziyan Fu, Ju Ren, Yunxin Liu, Ting Cao, Deyu Zhang, Yuezhi Zhou, Yaoxue Zhang
  
  ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- Turbo: Opportunistic Enhancement for Edge Video Analytics
  
  Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu
  
  The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- MobiDepth: Real-Time Depth Estimation Using On-Device Dual Cameras
  
  Jinrui Zhang, Huan Yang, Ju Ren, Deyu Zhang, Bangwen He, Yuanchun Li, Ting Cao, Yaoxue Zhang, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | October 2022
  
  Publication
- SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
  
  Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
  
  ACM International Conference on Information and Knowledge Management (CIKM’22) | October 2022
  
  Publication
- CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices
  
  Fucheng Jia, Deyu Zhang, Ting Cao, Shiqi Jiang, Yunxin Liu, Ju Ren, Yaoxue Zhang
  
  Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (MobiSys’22) | June 2022
  
  Publication
- Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
  
  Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
  
  HotMobile’22 | March 2022
  
  Publication
- AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs
  
  Manni Wang, Shaohua Ding, Ting Cao, Yunxin Liu, Fengyuan Xu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom’21) | October 2021
  
  Publication 项目
- Boosting Mobile CNN Inference through Semantic Memory
  
  Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
  
  Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
  
  Publication
- Flexible High-resolution Object Detection on Edge Devices with Tunable Latency
  
  Shiqi Jiang, Zhiqi Lin, Yuanchun Li, Yuanchao Shu, Yunxin Liu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom ’21)) | October 2021
  
  Publication
- AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
  
  Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
  
  August 2021
  
  发布者： arXiv | August 2021
  
  Publication
- To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
  
  Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
  
  MLSys | April 2021
  
  Publication
- Profiling and optimizing deep learning inference on mobile GPUs
  
  Shiqi Jiang, Lihao Ran, Ting Cao, Yusen Xu, Yunxin Liu
  
  Proceedings of the 11th ACM SIGOPS Asia-Pacific Workshop on Systems (APSys ’20) | August 2020
  
  Publication
- FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices
  
  Xiangyu Li, Yuanchun Li, Yuanzhe Li, Ting Cao, Yunxin Liu
  
  International Conference on Mobile Computing and Networking (MobiCom ’24) | November 2024
  
  Publication
- Anatomizing Deep Learning Inference in Web Browsers
  
  Qipeng Wang, Shiqi Jiang, Zhenpeng Chen, Xu Cao, Yuanchun Li, Aoyu Li, Yun Ma, Ting Cao, Xuanzhe Liu
  
  ACM Transactions on Software Engineering and Methodology | August 2024
  
  Publication
- Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
  
  Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
  
  ISCA 2024 | July 2024
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
  
  Publication
- Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
  
  Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
  
  the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024
  
  Publication
- Autodroid: LLM-Powered Task Automation in Android
  
  Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu
  
  the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024
  
  Publication
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
  
  Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
  
  29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’24) | April 2024
  
  Publication
- ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
  
  Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
  
  The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
  
  Best paper award
  
  Publication
- Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning
  
  Ya Nan, Shiqi Jiang, Mo Li
  
  ACM Transactions on Sensor Network | October 2023, 第 20 卷(1): pp. 1-23
  
  Publication
- LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
  
  Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23) | October 2023
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
  
  Publication 项目
- VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar Operations
  
  Chen Nie, Chenyu Tang, Jie Lin, Huan Hu, Chenyang Lv, Ting Cao, Weifeng Zhang, Li Jiang, Xiaoyao Liang, Weikang Qian, Yanan Sun, Zhezhi He
  
  IEEE Transactions on Computers | June 2023
  
  Publication
- NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
  
  Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
  
  The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
  
  Publication
- Boosting DNN Cold Inference on Devices
  
  Rongjie Yi, Ting Cao, Ao Zhou, Xiao Ma, Shangguang Wang, Mengwei Xu
  
  The 21st Annual International Conference on Mobile Systems, Applications and Services (MobiSys ’23) | June 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023
  
  Publication 项目
- AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments
  
  Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- The Case for Learning Machine Language
  
  Guangda Liu, Chieh-Jan Mike Liang, Shijie Cao, Shuai Lu, Leendert van Doorn
  
  ML for Systems at NeurIPS | December 2022
  
  Publication
- Hyperion: A Generic and Distributed Mobile Offloading Framework on OpenCL
  
  Ziyan Fu, Ju Ren, Yunxin Liu, Ting Cao, Deyu Zhang, Yuezhi Zhou, Yaoxue Zhang
  
  ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- Turbo: Opportunistic Enhancement for Edge Video Analytics
  
  Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu
  
  The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- MobiDepth: Real-Time Depth Estimation Using On-Device Dual Cameras
  
  Jinrui Zhang, Huan Yang, Ju Ren, Deyu Zhang, Bangwen He, Yuanchun Li, Ting Cao, Yaoxue Zhang, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | October 2022
  
  Publication
- CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices
  
  Fucheng Jia, Deyu Zhang, Ting Cao, Shiqi Jiang, Yunxin Liu, Ju Ren, Yaoxue Zhang
  
  Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (MobiSys’22) | June 2022
  
  Publication
- Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
  
  Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
  
  HotMobile’22 | March 2022
  
  Publication
- Romou: Rapidly Generate High-Performance Tensor Kernels for Mobile GPUs
  
  Rendong Liang, Ting Cao, Jicheng Wen, Manni Wang, Yang Wang, Jianhua Zou, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | February 2022
  
  2023 Top 100 Open Source Achievement Award
  
  Publication
- nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
  
  Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
  
  GetMobile: Mobile Computing and Communications | December 2021, 第 25 卷(4): pp. 19-23
  
  SigMobile Research Highlight
  
  Publication
- Unified Holistic Memory Management Supporting Multiple Big Data Processing Frameworks over Hybrid Memories
  
  Lei Chen, Jiacheng Zhao, Chenxi Wang, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu, Huimin Cui
  
  ACM Transactions on Computer Systems | November 2021, 第 39 卷(1-4): pp. 1-38
  
  Publication
- AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs
  
  Manni Wang, Shaohua Ding, Ting Cao, Yunxin Liu, Fengyuan Xu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom’21) | October 2021
  
  Publication 项目
- Boosting Mobile CNN Inference through Semantic Memory
  
  Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
  
  Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
  
  Publication
- Flexible High-resolution Object Detection on Edge Devices with Tunable Latency
  
  Shiqi Jiang, Zhiqi Lin, Yuanchun Li, Yuanchao Shu, Yunxin Liu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom ’21)) | October 2021
  
  Publication
- Fast Hardware-Aware Neural Architecture Search
  
  Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
  
  CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
  
  DOI PDF Publication
- Panthera: Holistic Memory Management for Big Data Processing over Hybrid Memories
  
  Chenxi Wang, Huimin Cui, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu
  
  the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’19) | June 2019
  
  Publication
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs
  
  Manni Wang, Shaohua Ding, Ting Cao, Yunxin Liu, Fengyuan Xu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom’21) | October 2021
  
  Publication 项目
- To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
  
  Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
  
  MLSys | April 2021
  
  Publication
- Profiling and optimizing deep learning inference on mobile GPUs
  
  Shiqi Jiang, Lihao Ran, Ting Cao, Yusen Xu, Yunxin Liu
  
  Proceedings of the 11th ACM SIGOPS Asia-Pacific Workshop on Systems (APSys ’20) | August 2020
  
  Publication

- Anatomizing Deep Learning Inference in Web Browsers
  
  Qipeng Wang, Shiqi Jiang, Zhenpeng Chen, Xu Cao, Yuanchun Li, Aoyu Li, Yun Ma, Ting Cao, Xuanzhe Liu
  
  ACM Transactions on Software Engineering and Methodology | August 2024
  
  Publication
- Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning
  
  Ya Nan, Shiqi Jiang, Mo Li
  
  ACM Transactions on Sensor Network | October 2023, 第 20 卷(1): pp. 1-23
  
  Publication
- VSPIM: SRAM Processing-in-Memory DNN Acceleration via Vector-Scalar Operations
  
  Chen Nie, Chenyu Tang, Jie Lin, Huan Hu, Chenyang Lv, Ting Cao, Weifeng Zhang, Li Jiang, Xiaoyao Liang, Weikang Qian, Yanan Sun, Zhezhi He
  
  IEEE Transactions on Computers | June 2023
  
  Publication
- nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
  
  Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
  
  GetMobile: Mobile Computing and Communications | December 2021, 第 25 卷(4): pp. 19-23
  
  SigMobile Research Highlight
  
  Publication
- Unified Holistic Memory Management Supporting Multiple Big Data Processing Frameworks over Hybrid Memories
  
  Lei Chen, Jiacheng Zhao, Chenxi Wang, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu, Huimin Cui
  
  ACM Transactions on Computer Systems | November 2021, 第 39 卷(1-4): pp. 1-38
  
  Publication
- FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices
  
  Xiangyu Li, Yuanchun Li, Yuanzhe Li, Ting Cao, Yunxin Liu
  
  International Conference on Mobile Computing and Networking (MobiCom ’24) | November 2024
  
  Publication
- Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
  
  Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang
  
  ISCA 2024 | July 2024
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-july-15-2024/
  
  Publication
- Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations
  
  Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang
  
  the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024
  
  Publication
- Autodroid: LLM-Powered Task Automation in Android
  
  Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu
  
  the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024
  
  Publication
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
  
  Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
  
  29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’24) | April 2024
  
  Publication
- ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores
  
  Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang
  
  The 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP ’24) | March 2024
  
  Best paper award
  
  Publication
- LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
  
  Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23) | October 2023
  
  Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
  
  Publication 项目
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
  
  Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
  
  INTERSPEECH 2023 | August 2023
  
  Publication
- NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors
  
  Jianyu Wei, Ting Cao, Shijie Cao, Shiqi Jiang, Shaowei Fu, Mao Yang, Yanyong Zhang, Yunxin Liu
  
  The 21st International Conference on Mobile Systems, Applications, and Services (MobiSys ’23) | June 2023
  
  Publication
- Boosting DNN Cold Inference on Devices
  
  Rongjie Yi, Ting Cao, Ao Zhou, Xiao Ma, Shangguang Wang, Mengwei Xu
  
  The 21st Annual International Conference on Mobile Systems, Applications and Services (MobiSys ’23) | June 2023
  
  Publication
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023
  
  Publication 项目
- AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments
  
  Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu
  
  The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- The Case for Learning Machine Language
  
  Guangda Liu, Chieh-Jan Mike Liang, Shijie Cao, Shuai Lu, Leendert van Doorn
  
  ML for Systems at NeurIPS | December 2022
  
  Publication
- Hyperion: A Generic and Distributed Mobile Offloading Framework on OpenCL
  
  Ziyan Fu, Ju Ren, Yunxin Liu, Ting Cao, Deyu Zhang, Yuezhi Zhou, Yaoxue Zhang
  
  ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- Turbo: Opportunistic Enhancement for Edge Video Analytics
  
  Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu
  
  The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022
  
  Publication
- MobiDepth: Real-Time Depth Estimation Using On-Device Dual Cameras
  
  Jinrui Zhang, Huan Yang, Ju Ren, Deyu Zhang, Bangwen He, Yuanchun Li, Ting Cao, Yaoxue Zhang, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | October 2022
  
  Publication
- SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
  
  Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
  
  ACM International Conference on Information and Knowledge Management (CIKM’22) | October 2022
  
  Publication
- CoDL: Efficient CPU-GPU Co-execution for Deep Learning Inference on Mobile Devices
  
  Fucheng Jia, Deyu Zhang, Ting Cao, Shiqi Jiang, Yunxin Liu, Ju Ren, Yaoxue Zhang
  
  Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services (MobiSys’22) | June 2022
  
  Publication
- Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
  
  Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
  
  HotMobile’22 | March 2022
  
  Publication
- Romou: Rapidly Generate High-Performance Tensor Kernels for Mobile GPUs
  
  Rendong Liang, Ting Cao, Jicheng Wen, Manni Wang, Yang Wang, Jianhua Zou, Yunxin Liu
  
  The 28th Annual International Conference On Mobile Computing And Networking (MobiCom’22) | February 2022
  
  2023 Top 100 Open Source Achievement Award
  
  Publication
- AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs
  
  Manni Wang, Shaohua Ding, Ting Cao, Yunxin Liu, Fengyuan Xu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom’21) | October 2021
  
  Publication 项目
- Boosting Mobile CNN Inference through Semantic Memory
  
  Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
  
  Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
  
  Publication
- Flexible High-resolution Object Detection on Edge Devices with Tunable Latency
  
  Shiqi Jiang, Zhiqi Lin, Yuanchun Li, Yuanchao Shu, Yunxin Liu
  
  The 27th Annual International Conference On Mobile Computing And Networking (MobiCom ’21)) | October 2021
  
  Publication
- To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
  
  Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
  
  MLSys | April 2021
  
  Publication
- Profiling and optimizing deep learning inference on mobile GPUs
  
  Shiqi Jiang, Lihao Ran, Ting Cao, Yusen Xu, Yunxin Liu
  
  Proceedings of the 11th ACM SIGOPS Asia-Pacific Workshop on Systems (APSys ’20) | August 2020
  
  Publication
- Fast Hardware-Aware Neural Architecture Search
  
  Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
  
  CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
  
  DOI PDF Publication
- Panthera: Holistic Memory Management for Big Data Processing over Hybrid Memories
  
  Chenxi Wang, Huimin Cui, Ting Cao, John Zigman, Haris Volos, Onur Mutlu, Fang Lv, Xiaobing Feng, Guoqing Harry Xu
  
  the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’19) | June 2019
  
  Publication
- AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
  
  Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
  
  August 2021
  
  发布者： arXiv | August 2021
  
  Publication