Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
ICPE | May 2025
Anjaly Parayil
Senior Researcher
Publications
-
-
-
Performance Aware LLM Load Balancer for Mixed Workloads
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
-
Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ArXiv | February 2025
-
-
-
Ensuring Fair LLM Serving Amid Diverse Applications
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
-
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
ArXiv | August 2024, Vol abs/2408.13510
-
X-lifecycle Learning for Cloud Incident Management using LLMs
Drishti Goel, Fiza Husain, Aditya Singh, Supriyo GHOSH, A. Parayil, Chetan Bansal, Xuchao Zhang, Saravan Rajmohan
Foundations of Software Engineering (FSE) | July 2024
-
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach
Pooja Srinivas, Fiza Husain, A. Parayil, Ayush Choure, Chetan Bansal, Saravan Rajmohan
46th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’24) | April 2024
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
ArXiv | April 2024, Vol abs/2404.19143
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
April 2024
-
-
-
Detection Is Better Than Cure: A Cloud Incidents Perspective
A. Parayil, Supriyo GHOSH, Yu Kang, Minghua Ma, Chetan Bansal, Suman Nath, Jonathan Mace, Vaibhav Ganatra
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
-
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN'23 | June 2023
-
-
-
On the Hidden Biases of Policy Mirror Ascent in Continuous Action Spaces
Amrit Singh Bedi, Souradip Chakraborty, Anjaly Parayil, Brian Sadler, Pratap Tokekar, Alec Koppel
ICML 2022 | July 2022
-
-
-
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control.
A. Parayil, A. S. Bedi* (equal contribution), J. Zhang, M. Wang, A. Koppel
December 2021
-
-
-
Decentralized Langevin Dynamics for Bayesian Learning
A. Parayil, He Bai, J. George, P. Gurram
2020 Neural Information Processing Systems | January 2020
-
-
-
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
ICPE | May 2025
-
Performance Aware LLM Load Balancer for Mixed Workloads
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
-
Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ArXiv | February 2025
-
Ensuring Fair LLM Serving Amid Diverse Applications
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
-
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
ArXiv | August 2024, Vol abs/2408.13510
-
X-lifecycle Learning for Cloud Incident Management using LLMs
Drishti Goel, Fiza Husain, Aditya Singh, Supriyo GHOSH, A. Parayil, Chetan Bansal, Xuchao Zhang, Saravan Rajmohan
Foundations of Software Engineering (FSE) | July 2024
-
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach
Pooja Srinivas, Fiza Husain, A. Parayil, Ayush Choure, Chetan Bansal, Saravan Rajmohan
46th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’24) | April 2024
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
April 2024
-
Detection Is Better Than Cure: A Cloud Incidents Perspective
A. Parayil, Supriyo GHOSH, Yu Kang, Minghua Ma, Chetan Bansal, Suman Nath, Jonathan Mace, Vaibhav Ganatra
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
-
On the Hidden Biases of Policy Mirror Ascent in Continuous Action Spaces
Amrit Singh Bedi, Souradip Chakraborty, Anjaly Parayil, Brian Sadler, Pratap Tokekar, Alec Koppel
ICML 2022 | July 2022
-
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control.
A. Parayil, A. S. Bedi* (equal contribution), J. Zhang, M. Wang, A. Koppel
December 2021
-
Decentralized Langevin Dynamics for Bayesian Learning
A. Parayil, He Bai, J. George, P. Gurram
2020 Neural Information Processing Systems | January 2020
-
-
-
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
ICPE | May 2025
-
Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ArXiv | February 2025
-
Ensuring Fair LLM Serving Amid Diverse Applications
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
-
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
ArXiv | August 2024, Vol abs/2408.13510
-
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach
Pooja Srinivas, Fiza Husain, A. Parayil, Ayush Choure, Chetan Bansal, Saravan Rajmohan
46th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’24) | April 2024
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
ArXiv | April 2024, Vol abs/2404.19143
-
Detection Is Better Than Cure: A Cloud Incidents Perspective
A. Parayil, Supriyo GHOSH, Yu Kang, Minghua Ma, Chetan Bansal, Suman Nath, Jonathan Mace, Vaibhav Ganatra
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
-
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN'23 | June 2023
-
-
-
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach
Pooja Srinivas, Fiza Husain, A. Parayil, Ayush Choure, Chetan Bansal, Saravan Rajmohan
46th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’24) | April 2024
-
Detection Is Better Than Cure: A Cloud Incidents Perspective
A. Parayil, Supriyo GHOSH, Yu Kang, Minghua Ma, Chetan Bansal, Suman Nath, Jonathan Mace, Vaibhav Ganatra
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
-
-
-
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control.
A. Parayil, A. S. Bedi* (equal contribution), J. Zhang, M. Wang, A. Koppel
December 2021
-
Decentralized Langevin Dynamics for Bayesian Learning
A. Parayil, He Bai, J. George, P. Gurram
2020 Neural Information Processing Systems | January 2020
-
-
-
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
ICPE | May 2025
-
Performance Aware LLM Load Balancer for Mixed Workloads
Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
EuroMLSys 2025 | April 2025
-
X-lifecycle Learning for Cloud Incident Management using LLMs
Drishti Goel, Fiza Husain, Aditya Singh, Supriyo GHOSH, A. Parayil, Chetan Bansal, Xuchao Zhang, Saravan Rajmohan
Foundations of Software Engineering (FSE) | July 2024
-
Intelligent Monitoring Framework for Cloud Services: A Data-Driven Approach
Pooja Srinivas, Fiza Husain, A. Parayil, Ayush Choure, Chetan Bansal, Saravan Rajmohan
46th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’24) | April 2024
-
Detection Is Better Than Cure: A Cloud Incidents Perspective
A. Parayil, Supriyo GHOSH, Yu Kang, Minghua Ma, Chetan Bansal, Suman Nath, Jonathan Mace, Vaibhav Ganatra
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
-
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN'23 | June 2023
-
On the Hidden Biases of Policy Mirror Ascent in Continuous Action Spaces
Amrit Singh Bedi, Souradip Chakraborty, Anjaly Parayil, Brian Sadler, Pratap Tokekar, Alec Koppel
ICML 2022 | July 2022
-
Decentralized Langevin Dynamics for Bayesian Learning
A. Parayil, He Bai, J. George, P. Gurram
2020 Neural Information Processing Systems | January 2020
-
-
-
Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
ArXiv | February 2025
-
Ensuring Fair LLM Serving Amid Diverse Applications
Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
ArXiv | November 2024
-
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
ArXiv | August 2024, Vol abs/2408.13510
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
ArXiv | April 2024, Vol abs/2404.19143
-
Workload Intelligence: Punching Holes Through the Cloud Abstraction
Lexiang Huang, A. Parayil, Jue Zhang, Xiaoting Qin, Chetan Bansal, Jovan Stojkovic, Pantea Zardoshti, Pulkit Misra, Eli Cortez, Raphael Ghelman, Íñigo Goiri, Saravan Rajmohan, Jim Kleewein, Rodrigo Fonseca, Timothy Zhu, Ricardo Bianchini
April 2024
-
-
-
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control.
A. Parayil, A. S. Bedi* (equal contribution), J. Zhang, M. Wang, A. Koppel
December 2021
-