LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
Li Lyna Zhang
Principal Researcher
Papiers de Collaboration
-
-
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
-
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
MSR-TR-2024-12 | August 2024
Publié par Microsoft
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
-
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
-
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
-
-
nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23
SigMobile Research Highlight
-
Boosting Mobile CNN Inference through Semantic Memory
Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
-
AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
August 2021
Publié par : arXiv | August 2021
-
nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021
Best Paper Award
-
To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
MLSys | April 2021
-
-
-
Fast Hardware-Aware Neural Architecture Search
Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
-
-
-
Characterizing Privacy Risks of Mobile Apps with Sensitivity Analysis
Li Lyna Zhang, Chieh-Jan Mike Liang, Zhao Lucis Li, Yunxin Liu, Feng Zhao, Enhong Chen
TMC (IEEE Transactions on Mobile Computing) | February 2018, Vol 17: pp. 279-292
-
-
-
Systematically Testing Background Services of Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Yunxin Liu, Enhong Chen
ASE (International Conference on Automated Software Engineering) | October 2017
-
Towards A Contextual and Scalable Automated-testing Service for Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Wei Zhang, Enhong Chen
HotMobile | February 2017
-
-
-
Caiipa: Automated Large-scale Mobile App Testing through Contextual Fuzzing
Chieh-Jan Mike Liang, Nicholas D. Lane, Niels Brouwers, Li Lyna Zhang, Börje F. Karlsson, Hao Liu, Yan Liu, Jun Tang, Xiang Shan, Ranveer Chandra, Feng Zhao
MobiCom (International Conference on Mobile Computing and Networking) | September 2014
-
-
-
Crossroads: A Framework for Developing Proximity-based Social Interactions
Chieh-Jan Mike Liang, Haozhun Jin, Yang Yang, Li Lyna Zhang, Feng Zhao
Mobiquitous (International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services) | December 2013
-
-
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
MSR-TR-2024-12 | August 2024
Publié par Microsoft
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
Boosting Mobile CNN Inference through Semantic Memory
Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
-
AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
August 2021
Publié par : arXiv | August 2021
-
nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021
Best Paper Award
-
To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
MLSys | April 2021
-
-
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23
SigMobile Research Highlight
-
Boosting Mobile CNN Inference through Semantic Memory
Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
-
nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021
Best Paper Award
-
Fast Hardware-Aware Neural Architecture Search
Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
-
Characterizing Privacy Risks of Mobile Apps with Sensitivity Analysis
Li Lyna Zhang, Chieh-Jan Mike Liang, Zhao Lucis Li, Yunxin Liu, Feng Zhao, Enhong Chen
TMC (IEEE Transactions on Mobile Computing) | February 2018, Vol 17: pp. 279-292
-
Systematically Testing Background Services of Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Yunxin Liu, Enhong Chen
ASE (International Conference on Automated Software Engineering) | October 2017
-
Towards A Contextual and Scalable Automated-testing Service for Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Wei Zhang, Enhong Chen
HotMobile | February 2017
-
Caiipa: Automated Large-scale Mobile App Testing through Contextual Fuzzing
Chieh-Jan Mike Liang, Nicholas D. Lane, Niels Brouwers, Li Lyna Zhang, Börje F. Karlsson, Hao Liu, Yan Liu, Jun Tang, Xiang Shan, Ranveer Chandra, Feng Zhao
MobiCom (International Conference on Mobile Computing and Networking) | September 2014
-
Crossroads: A Framework for Developing Proximity-based Social Interactions
Chieh-Jan Mike Liang, Haozhun Jin, Yang Yang, Li Lyna Zhang, Feng Zhao
Mobiquitous (International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services) | December 2013
-
-
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
-
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
-
-
nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021
Best Paper Award
-
To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
MLSys | April 2021
-
-
-
LongRoPE2: Near-Lossless LLM Context Window Scaling
Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
ICML 2025 | July 2025
-
rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
ICML 2025 (oral) | January 2025
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
-
Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
ICLR 2025 | August 2024
-
LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search
Chengquan Feng, Li Lyna Zhang, Yuanchi Liu, Jiahang Xu, Chengruidong Zhang, Zhiyuan Wang, Ting Cao, Mao Yang, Haisheng Tan
NSDI 2024 | April 2024
-
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
ICML 2024 | February 2024
-
Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
EMNLP | February 2024
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.rarnonalumber.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Chen Tang, Li Lyna Zhang, Huiqiang Jiang, Jiahang Xu, Ting Cao, Quanlu Zhang, Yuqing Yang, Zhi Wang, Mao Yang
ICCV 2023 | October 2023
-
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
Xudong Wang, Li Lyna Zhang, Jiahang Xu, Quanlu Zhang, Yujing Wang, Yuqing Yang, Ningxin Zheng, Ting Cao, Mao Yang
ICCV 2023 | October 2023
-
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu
INTERSPEECH 2023 | August 2023
-
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Junyan Li, Li Lyna Zhang, Jiahang Xu, Yujing Wang, Shaoguang Yan, Yunqing Xia, Yuqing Yang, Ting Cao, Hao Sun, Weiwei Deng, Qi Zhang, Mao Yang
KDD 2023 | August 2023
-
On Modular Learning of Distributed Systems for Predicting End-to-End Latency
Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
-
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen
ACM International Conference on Information and Knowledge Management (CIKM'22) | October 2022
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
Boosting Mobile CNN Inference through Semantic Memory
Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu
Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) | October 2021
-
nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'21) | June 2021
Best Paper Award
-
To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks
Xiaohu Tang, Shihao Han, Li Lyna Zhang, Ting Cao, Yunxin Liu
MLSys | April 2021
-
Fast Hardware-Aware Neural Architecture Search
Li Lyna Zhang, Yuqing Yang, Yuhang Jiang, Wenwu Zhu, Yunxin Liu
CVPRW (Joint Workshop on Efficient Deep Learning in Computer Vision) | June 2020
-
Systematically Testing Background Services of Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Yunxin Liu, Enhong Chen
ASE (International Conference on Automated Software Engineering) | October 2017
-
Towards A Contextual and Scalable Automated-testing Service for Mobile Apps
Li Lyna Zhang, Chieh-Jan Mike Liang, Wei Zhang, Enhong Chen
HotMobile | February 2017
-
Caiipa: Automated Large-scale Mobile App Testing through Contextual Fuzzing
Chieh-Jan Mike Liang, Nicholas D. Lane, Niels Brouwers, Li Lyna Zhang, Börje F. Karlsson, Hao Liu, Yan Liu, Jun Tang, Xiang Shan, Ranveer Chandra, Feng Zhao
MobiCom (International Conference on Mobile Computing and Networking) | September 2014
-
Crossroads: A Framework for Developing Proximity-based Social Interactions
Chieh-Jan Mike Liang, Haozhun Jin, Yang Yang, Li Lyna Zhang, Feng Zhao
Mobiquitous (International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services) | December 2013
-
-
-
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
MSR-TR-2024-12 | August 2024
Publié par Microsoft
-
-
-
nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices
Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu
GetMobile: Mobile Computing and Communications | December 2021, Vol 25(4): pp. 19-23
SigMobile Research Highlight
-
Characterizing Privacy Risks of Mobile Apps with Sensitivity Analysis
Li Lyna Zhang, Chieh-Jan Mike Liang, Zhao Lucis Li, Yunxin Liu, Feng Zhao, Enhong Chen
TMC (IEEE Transactions on Mobile Computing) | February 2018, Vol 17: pp. 279-292
-
-
-
AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing
Yuge Zhang, Chenqian Yan, Quanlu Zhang, Li Lyna Zhang, Yaming Yang, Xiaotian Gao, Yuqing Yang
August 2021
Publié par : arXiv | August 2021
-