Interactive Debugging and Steering of Multi-Agent AI Systems
Will Epperson, Gagan Bansal, Victor Dibia, Adam Fourney (adamfo), Jack Gerrits, Erkang (Eric) Zhu, Saleema Amershi
CHI 2025 | April 2025
Publications
Publications by Year
-
-
Challenges in Human-Agent Communication
Gagan Bansal, Jennifer Wortman Vaughan, Saleema Amershi, Eric Horvitz, Adam Fourney, Hussein Mozannar, Victor Dibia, Daniel S. Weld
MSR-TR-2024-53 | December 2024
Published by Microsoft
Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi
MSR-TR-2024-47 | November 2024
Published by Microsoft
AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems
Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi
August 2024
Preprint
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
COLM 2024 | August 2024
Best Paper, LLM Agents Workshop ICLR'24
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ToCHI | August 2024
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Honorable Mention, CHI 2024
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
AAAI 2024 | January 2024
-
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal
Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7
Article 370
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
-
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
-
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
-
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
-
The Challenge of Crafting Intelligible Intelligence
Daniel S. Weld, Gagan Bansal
Communications of ACM | October 2018
Publications by Research Area
-
Interactive Debugging and Steering of Multi-Agent AI Systems
Will Epperson, Gagan Bansal, Victor Dibia, Adam Fourney (adamfo), Jack Gerrits, Erkang (Eric) Zhu, Saleema Amershi
CHI 2025 | April 2025
Challenges in Human-Agent Communication
Gagan Bansal, Jennifer Wortman Vaughan, Saleema Amershi, Eric Horvitz, Adam Fourney, Hussein Mozannar, Victor Dibia, Daniel S. Weld
MSR-TR-2024-53 | December 2024
Published by Microsoft
Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi
MSR-TR-2024-47 | November 2024
Published by Microsoft
AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems
Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi
August 2024
Preprint
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
COLM 2024 | August 2024
Best Paper, LLM Agents Workshop ICLR'24
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ToCHI | August 2024
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Honorable Mention, CHI 2024
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal
Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7
Article 370
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
The Challenge of Crafting Intelligible Intelligence
Daniel S. Weld, Gagan Bansal
Communications of ACM | October 2018
-
Interactive Debugging and Steering of Multi-Agent AI Systems
Will Epperson, Gagan Bansal, Victor Dibia, Adam Fourney (adamfo), Jack Gerrits, Erkang (Eric) Zhu, Saleema Amershi
CHI 2025 | April 2025
Challenges in Human-Agent Communication
Gagan Bansal, Jennifer Wortman Vaughan, Saleema Amershi, Eric Horvitz, Adam Fourney, Hussein Mozannar, Victor Dibia, Daniel S. Weld
MSR-TR-2024-53 | December 2024
Published by Microsoft
AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems
Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang (Eric) Zhu, Chi Wang, Saleema Amershi
August 2024
Preprint
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
COLM 2024 | August 2024
Best Paper, LLM Agents Workshop ICLR'24
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ToCHI | August 2024
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
AAAI 2024 | January 2024
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal
Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7
Article 370
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
The Challenge of Crafting Intelligible Intelligence
Daniel S. Weld, Gagan Bansal
Communications of ACM | October 2018
-
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Publications by Type
-
Interactive Debugging and Steering of Multi-Agent AI Systems
Will Epperson, Gagan Bansal, Victor Dibia, Adam Fourney (adamfo), Jack Gerrits, Erkang (Eric) Zhu, Saleema Amershi
CHI 2025 | April 2025
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
COLM 2024 | August 2024
Best Paper, LLM Agents Workshop ICLR'24
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
CHI 2024 | May 2024
Honorable Mention, CHI 2024
When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming
Hussein Mozannar, Gagan Bansal, Adam Fourney, Eric Horvitz
AAAI 2024 | January 2024
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | June 2023
Aligning Offline Metrics and Human Judgments of Value of AI-Pair Programmers
Victor Dibia, Adam Fourney, Gagan Bansal, Forough Poursabzi-Sangdeh (SHE/HER), Han Liu, Saleema Amershi
ACL 2023 | October 2022
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, Daniel S. Weld
CHI | May 2021
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Gagan Bansal, Besmira Nushi, Ece Kamar, Eric Horvitz, Dan Weld
AAAI 2021 | February 2021
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter Lasecki, Dan Weld, Eric Horvitz
HCOMP 2019 | October 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Gagan Bansal, Besmira Nushi, Ece Kamar, Dan Weld, Walter Lasecki, Eric Horvitz
AAAI Conference on Artificial Intelligence | January 2019
-
Challenges in Human-Agent Communication
Gagan Bansal, Jennifer Wortman Vaughan, Saleema Amershi, Eric Horvitz, Adam Fourney, Hussein Mozannar, Victor Dibia, Daniel S. Weld
MSR-TR-2024-53 | December 2024
Published by Microsoft
Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn, Saleema Amershi
MSR-TR-2024-47 | November 2024
Published by Microsoft
-
-
Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions
Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, Jennifer Wortman Vaughan
ToCHI | August 2024
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan Bansal
Proc. ACM Hum.-Comput. Interact. | October 2023, Vol 7
Article 370
The Challenge of Crafting Intelligible Intelligence
Daniel S. Weld, Gagan Bansal
Communications of ACM | October 2018