Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
Aashaka Shah
Senior Researcher
Publications
-
-
-
-
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh
November 2021
-
Memory Optimization for Deep Networks
Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krahenbuhl
International Conference on Learning Representations (ICLR 2021) | May 2021
-
-
-
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
-
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh
November 2021
-
Memory Optimization for Deep Networks
Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krahenbuhl
International Conference on Learning Representations (ICLR 2021) | May 2021
-
-
-
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh
November 2021
-
-
-
Memory Optimization for Deep Networks
Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krahenbuhl
International Conference on Learning Representations (ICLR 2021) | May 2021
-
-
-
Memory Optimization for Deep Networks
Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krahenbuhl
International Conference on Learning Representations (ICLR 2021) | May 2021
-
-
-
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
-
Memory Optimization for Deep Networks
Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krahenbuhl
International Conference on Learning Representations (ICLR 2021) | May 2021
-
-
-
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Aashaka Shah, Vijay Chidambaram, Meghan Cowan, Saeed Maleki, Madan Musuvathi, Todd Mytkowicz, Jacob Nelson, Olli Saarikivi, Rachee Singh
November 2021
-