Deriving Semantic Checkers from Tests to Detect Silent Failures in Production Distributed Systems

Chang Lou, Dimas Shidqi Parikesit, Yujin Huang, Zhewen Yang, Senapati Diwangkara, Yuzhuo Jing, Achmad Imam Kistijantoro, Ding Yuan, Suman Nath, Peng Huang

OSDI’25: 19th USENIX Symposium on Operating Systems Design and Implementation | July 2025

Publication

ReproCopilot: LLM-Driven Failure Reproduction with Dynamic Refinement

Tanakorn Leesatapornwongsa, Fazle Faisal, Suman Nath

FSE’25: International Conference on the Foundations of Software Engineering | June 2025

Publication

AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud

Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

MLSys ’25 | May 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

Fidelity of Cloud Emulators: The Imitation Game of Testing Cloud-based Software

Anna Mazhar , Saad Sher Alam , William Zheng , Yinfang Chen , Suman Nath, Tianyin Xu

International Conference on Software Engineering (ICSE) | April 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

2024 Symposium on Cloud Computing | November 2024

Publication

Efficient Reproduction of Fault-Induced Failures in Distributed Systems with Feedback-Driven Fault Injection

Jia Pan, Haoze Wu , Tanakorn Leesatapornwongsa, Suman Nath, Peng Huang

ACM SOSP 2024 | November 2024

Publication Project

If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems

Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath

ACM SOSP 2024 | November 2024

Publication

ExChain: Exception Dependency Analysis for Root Cause Diagnosis

Ao Li, Shan Lu, Suman Nath, Rohan Padhye, Vyas Sekar

USENIX NSDI | April 2024

Publication Project

Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications

João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues

2023 Symposium on Operating Systems Principles | October 2023

Publication

Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications

Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace

2023 Symposium on Operating Systems Principles | October 2023

Publication

AutoARTS: Taxonomy, Insights and Tools for Root Cause Labelling of Incidents in Microsoft Azure

Pradeep Dogga, Chetan Bansal, Richard Costleigh, Gopinath Jayagopal, Suman Nath, Xuchao Zhang

2023 USENIX Annual Technical Conference | July 2023

Publication Project

Deriving Semantic Checkers from Tests to Detect Silent Failures in Production Distributed Systems

Chang Lou, Dimas Shidqi Parikesit, Yujin Huang, Zhewen Yang, Senapati Diwangkara, Yuzhuo Jing, Achmad Imam Kistijantoro, Ding Yuan, Suman Nath, Peng Huang

OSDI’25: 19th USENIX Symposium on Operating Systems Design and Implementation | July 2025

Publication

ReproCopilot: LLM-Driven Failure Reproduction with Dynamic Refinement

Tanakorn Leesatapornwongsa, Fazle Faisal, Suman Nath

FSE’25: International Conference on the Foundations of Software Engineering | June 2025

Publication

AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud

Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

MLSys ’25 | May 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

Fidelity of Cloud Emulators: The Imitation Game of Testing Cloud-based Software

Anna Mazhar , Saad Sher Alam , William Zheng , Yinfang Chen , Suman Nath, Tianyin Xu

International Conference on Software Engineering (ICSE) | April 2025

Publication

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

2024 Symposium on Cloud Computing | November 2024

Publication

If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems

Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath

ACM SOSP 2024 | November 2024

Publication

Efficient Reproduction of Fault-Induced Failures in Distributed Systems with Feedback-Driven Fault Injection

Jia Pan, Haoze Wu , Tanakorn Leesatapornwongsa, Suman Nath, Peng Huang

ACM SOSP 2024 | November 2024

Publication Project

ExChain: Exception Dependency Analysis for Root Cause Diagnosis

Ao Li, Shan Lu, Suman Nath, Rohan Padhye, Vyas Sekar

USENIX NSDI | April 2024

Publication Project

Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications

Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace

2023 Symposium on Operating Systems Principles | October 2023

Publication

Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications

João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues

2023 Symposium on Operating Systems Principles | October 2023

Publication

AutoARTS: Taxonomy, Insights and Tools for Root Cause Labelling of Incidents in Microsoft Azure

Pradeep Dogga, Chetan Bansal, Richard Costleigh, Gopinath Jayagopal, Suman Nath, Xuchao Zhang

2023 USENIX Annual Technical Conference | July 2023

Publication Project

AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud

Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

MLSys ’25 | May 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

2024 Symposium on Cloud Computing | November 2024

Publication

Fidelity of Cloud Emulators: The Imitation Game of Testing Cloud-based Software

Anna Mazhar , Saad Sher Alam , William Zheng , Yinfang Chen , Suman Nath, Tianyin Xu

International Conference on Software Engineering (ICSE) | April 2025

Publication

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

2024 Symposium on Cloud Computing | November 2024

Publication

AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud

Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

MLSys ’25 | May 2025

Publication

Deriving Semantic Checkers from Tests to Detect Silent Failures in Production Distributed Systems

Chang Lou, Dimas Shidqi Parikesit, Yujin Huang, Zhewen Yang, Senapati Diwangkara, Yuzhuo Jing, Achmad Imam Kistijantoro, Ding Yuan, Suman Nath, Peng Huang

OSDI’25: 19th USENIX Symposium on Operating Systems Design and Implementation | July 2025

Publication

ReproCopilot: LLM-Driven Failure Reproduction with Dynamic Refinement

Tanakorn Leesatapornwongsa, Fazle Faisal, Suman Nath

FSE’25: International Conference on the Foundations of Software Engineering | June 2025

Publication

AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud

Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan

MLSys ’25 | May 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

WABER: Evaluating Reliability and Efficiency of Web Agents with Existing Benchmarks

Su Kara, Fazle Faisal, Suman Nath

ICLR 2025 Workshop on Foundation Models in the Wild | April 2025

Publication

Fidelity of Cloud Emulators: The Imitation Game of Testing Cloud-based Software

Anna Mazhar , Saad Sher Alam , William Zheng , Yinfang Chen , Suman Nath, Tianyin Xu

International Conference on Software Engineering (ICSE) | April 2025

Publication

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

2024 Symposium on Cloud Computing | November 2024

Publication

If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems

Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath

ACM SOSP 2024 | November 2024

Publication

Efficient Reproduction of Fault-Induced Failures in Distributed Systems with Feedback-Driven Fault Injection

Jia Pan, Haoze Wu , Tanakorn Leesatapornwongsa, Suman Nath, Peng Huang

ACM SOSP 2024 | November 2024

Publication Project

ExChain: Exception Dependency Analysis for Root Cause Diagnosis

Ao Li, Shan Lu, Suman Nath, Rohan Padhye, Vyas Sekar

USENIX NSDI | April 2024

Publication Project

Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications

Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace

2023 Symposium on Operating Systems Principles | October 2023

Publication

Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications

João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues

2023 Symposium on Operating Systems Principles | October 2023

Publication

AutoARTS: Taxonomy, Insights and Tools for Root Cause Labelling of Incidents in Microsoft Azure

Pradeep Dogga, Chetan Bansal, Richard Costleigh, Gopinath Jayagopal, Suman Nath, Xuchao Zhang

2023 USENIX Annual Technical Conference | July 2023

Publication Project