Execution-guided within-prompt search for programming-by-example
Gust Verbruggen, Ashish Tiwari, Mukul Singh, Vu Le, Sumit Gulwani
ICLR | April 2025
Sumit Gulwani
Distinguished Scientist and Vice President
Publications
Publications by Year
-
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
METAREFLECTION: Learning Instructions for Language Agents using Past Reflections
Priyanshu Gupta, Shashank Kirtania, Ananya Singha, Sumit Gulwani, Arjun Radhakrishna, Sherry Shi, Gustavo Soares
EMNLP'24 | October 2024
STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with Feedback
Naman Gupta, Shashank Kirtania, Priyanshu Gupta, Krishna Kariya, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy, Arjun Radhakrishna, Sriram Rajamani, Gustavo Soares
October 2024
Preprint
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Let’s Fix this Together: Conversational Debugging with GitHub Copilot
Yasharth Bajpai, Bhavya Chopra, Param Biyani, Cagri Aslan, Sumit Gulwani, Dustin Coleman, Chris Parnin, Arjun Radhakrishna, Gustavo Soares
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | August 2024
Best Research Paper Award
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
RUBICON: Rubric-based Evaluation of Domain Specific Human-AI Conversations
Param Biyani, Yasharth Bajpai, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani
AIware: Proceedings of the 1st ACM International Conference on AI-Powered Software | July 2024
Best Paper Presentation Award
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation
Tung Phung, Victor-Alexandru Pădurean, Anjali Singh, Christopher Brooks, José Cambronero, Sumit Gulwani, Adish Singla, Gustavo Soares
International Learning Analytics and Knowledge Conference | March 2024
Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Bhavya Chopra, Yasharth Bajpai, Param Biyani, Gustavo Soares, Arjun Radhakrishna, Chris Parnin, Sumit Gulwani
NAACL: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing | February 2024
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
Investigating Student Mistakes in Introductory Data Science Programming
Anjali Singh, Anna Fariha, Christopher Brooks, Gustavo Soares, Austin Z. Henley, Ashish Tiwari, Chethan M, Heeryung Choi, Sumit Gulwani
Technical Symposium on Computer Science Education | January 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
-
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMs
Ananya Singha, José Cambronero, Sumit Gulwani, Vu Le, Chris Parnin
Table Representation Learning Workshop at NeurIPS 2023 | December 2023
Grace: Language Models Meet Code Edits
Priyanshu Gupta, Avishree Khare, Yasharth Bajpai, Saikat Chakraborty, Sumit Gulwani, Aditya Kanade, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors
Tung Phung, Victor-Alexandru Padurean, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, Gustavo Soares
Conference on International Computing Education Research | September 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models
Tung Phung, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adisha Singla, Gustavo Soares
International Conference on Educational Data Mining | July 2023
CoWrangler: Recommender System for Data-Wrangling Scripts
Bhavya Chopra, Anna Fariha, Sumit Gulwani, Austin Z. Henley, Daniel Perelman, Mohammad Raza, Sherry Shi, Danny Simmons, Ashish Tiwari
SIGMOD | June 2023
From Words to Code: Harnessing Data for Program Synthesis from Natural Language
Anirudh Khatry, Joyce Cahoon, Jordan Henkel, Shaleen Deep, Venkatesh Emani, Avrilia Floratou, Sumit Gulwani, Vu Le, Mohammad Raza, Sherry Shi, Mukul Singh, Ashish Tiwari
May 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
FlashFill++: Scaling Programming by Example by Cutting to the Chase
José Cambronero, Sumit Gulwani, Vu Le, Daniel Perelman, Arjun Radhakrishna, Clint Simon, Ashish Tiwari
Principles of Programming Languages | January 2023
-
Neurosymbolic Repair for Low-Code Formula Languages
Rohan Bavishi, Harshit Joshi, José Cambronero, Anna Fariha, Sumit Gulwani, Vu Le, Ivan Radicek, Ashish Tiwari
OOPSLA | December 2022
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
NL2Viz: Natural Language to Visualization via Constrained Syntax-Guided Synthesis
Zhengkai Wu, Vu Le, Ashish Tiwari, Sumit Gulwani, Arjun Radhakrishna, Ivan Radicek, Gustavo Soares, Xinyu Wang, Zhenwen Li, Tao Xie
FSE | November 2022
Overwatch: Learning Patterns in Code Edit Sequences
Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltos Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, Gustavo Soares, Ashish Tiwari
OOPSLA: Proceedings of the ACM on Programming Languages | October 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
AI-assisted Programming | IJCAI-ECAI 2022 Keynote by Sumit Gulwani
August 2022
PROSE Research Fellowship Program
Sumit Gulwani, Arjun Radhakrishna
May 2022
Synchromesh: Reliable code generation from pre-trained language models
Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
ICLR 2022 | April 2022
Shaping the future with: Sumit Gulwani
March 2022
Max Planck-Humboldt Medal 2021
Storytelling and Science
Titus Barik, Sumit Gulwani, Mario Juarez
March 2022
-
Multi-modal Program Inference: a Marriage of Pre-trained Language Models and Component-based Synthesis
Kia Rahmani, Mohammad Raza (moraza), Sumit Gulwani (sumitg), Vu Le (levu), Dan Morris (damorri), Arjun Radhakrishna (arradha), Gustavo Soares (gsoares), Ashish Tiwari (astiwar)
OOPSLA | October 2021
reCode: A Lightweight Find-and-Replace Interaction in the IDE for Transforming Code by Example
Wode Ni, Joshua Sunshine, Vu Le, Sumit Gulwani, Titus Barik
UIST 2021 | October 2021
Semantic programming by example with pre-trained models
Gust Verbruggen, Vu Le, Sumit Gulwani
OOPSLA | October 2021
APIfix: Output-Oriented Program Synthesis for Combating Breaking Changes in Libraries
Xiang Gao, Arjun Radhakrishna, Gustavo Soares, Ridwan Shariffdeen, Sumit Gulwani, Abhik Roychoudhury
OOPSLA | September 2021
Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani, Alexandra Meliou
Proceedings of the 2021 International Conference on Management of Data | June 2021
Can Program Synthesis be Used to Learn Merge Conflict Resolutions? An Empirical Analysis
Rangeet Pan, Vu Le, Nachi Nagappan, Sumit Gulwani, Shuvendu Lahiri, Mike Kaufman
2021 IEEE/ACM 43nd International Conference on Software Engineering (ICSE '21) | May 2021
-
Structure interpretation of text formats
Sumit Gulwani, Vu Le, Arjun Radhakrishna, Ivan Radicek, Mohammad Raza
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | November 2020
DOI PDF Author's Version Publication Publication Publication Video Project Project Project
An Integrated Approach of Deep Learning and Symbolic Analysis for Digital PDF Table Extraction
Mengshi Zhang, Daniel Perelman, Vu Le, Sumit Gulwani
International Conference on Pattern Recognition | October 2020
Feedback-Driven Semi-Supervised Synthesis of Program Transformations
Xiang Gao, Shraddha Barke, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani, Alan Leung, Nachi Nagappan, Ashish Tiwari
OOPSLA | October 2020
Programming by Rewards
Nagarajan Natarajan, Ajaykrishna Karthikeyan, Prateek Jain, Ivan Radicek, Sriram Rajamani, Sumit Gulwani, Johannes Gehrke
July 2020
ExTuNe: Explaining Tuple Non-conformance
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani
2020 International Conference on Management of Data | June 2020
Web data extraction using hybrid program synthesis: a combination of top-down and bottom-up inference
Mohammad Raza, Sumit Gulwani
SIGMOD (Special Interest Group on Management of Data) | June 2020
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
-
On the fly synthesis of edit suggestions
Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, Abhishek Udupa
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2019
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
Dependable Software Systems Engineering | Published by IOS Press | 2019
Learning Natural Programs from a Few Examples in Real-Time
Nagarajan Natarajan, Danny Simmons, Naren Datha (narend), Prateek Jain, Sumit Gulwani
AIStats | January 2019
-
FlashProfile: A Framework for Synthesizing Data Profiles
Saswat Padhi, Daniel Perelman, Prateek Jain, Alex Polozov, Sumit Gulwani, Todd Millstein
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH - OOPSLA) | November 2018
Automated Clustering and Program Repair for Introductory Programming Assignments
Sumit Gulwani, Ivan Radicek, Florian Zuleger
PLDI | May 2018
Compilation Error Repair: For the Student Programs, From the Student Programs
Umair Ahmed, Pawan Kumar, Amey Karkare, Purushottam Kar, Sumit Gulwani
40th International Conference on Software Engineering (ICSE), Software Engineering Education and Training Track | February 2018
Disjunctive Program Synthesis: A Robust Approach to Programming by Example
Mohammad Raza, Sumit Gulwani
AAAI 2018 | February 2018
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Ashwin Kalyan, Abhishek Mohta, Alex Polozov, Dhruv Batra, Prateek Jain, Sumit Gulwani
6th International Conference on Learning Representations (ICLR) | January 2018
Automatic Diagnosis of Students’ Misconceptions in K-8 Mathematics
Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popovic, Erik Andersen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | January 2018
-
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
APLAS 2017 | October 2017
FlashProfile: Interactive Synthesis of Syntactic Profiles
Saswat Padhi, Prateek Jain, Daniel Perelman, Alex Polozov, Sumit Gulwani, Todd Milstein
arXiv preprint | September 2017, Vol arXiv:1709.05725
Program Synthesis
Sumit Gulwani, Alex Polozov, Rishabh Singh
Foundations and Trends in Programming Languages
Published by NOW | August 2017, Vol 4
Research for Practice: Programming by Examples
Research for Practice, CACM | July 2017, Vol 60: pp. 46-49
Learning Syntactic Program Transformations from Examples
Reudismam Rolim, Gustavo Soares (gsoares), Loris D'Antoni, Alex Polozov, Sumit Gulwani, Rohit Gheyi, Bjoern Hartmann
39th International Conference on Software Engineering (ICSE) | May 2017
Learning to Learn Programs from Examples: Going Beyond Program Structure
Kevin Ellis, Sumit Gulwani
IJCAI 2017 | May 2017
Interactive Program Synthesis
Vu Le, Daniel Perelman, Alex Polozov, Mohammad Raza (moraza), Abhishek Udupa, Sumit Gulwani
arXiv preprint | March 2017, Vol arXiv:1703.03539
Automated Data Extraction using Predictive Program Synthesis
Mohammad Raza, Sumit Gulwani
AAAI 2017 | February 2017
-
Ringer: Web Automation by Demonstration
Shaon Barman, Sarah Chasins, Ras Bodik, Sumit Gulwani
OOPSLA 2016 | November 2016
FIDEX: Filtering Spreadsheet Data using Examples
Xinyu Wang, Sumit Gulwani, Rishabh Singh
OOPSLA'16 October 25-30, 2016, The Netherlands | October 2016
Programming by Examples: Applications, Algorithms, and Ambiguity Resolution
Invited talk at IJCAR 2016 | June 2016
Program Synthesis using Natural Language
Aditya Desai, Sumit Gulwani, Vineet Hingorani, Nidhi Jain, Amey Karkare, Mark Marron, Sailesh R, Subhajit Roy
ICSE '16, Austin, TX, USA | May 2016
Program Synthesis Using Natural Language
Aditya Desai , Sumit Gulwani, Vineet Hingorani , Nidhi Jain , Amey Karkare , Mark Marron, Sailesh R , Subhajit Roy
ICSE '16 Proceedings of the 38th International Conference on Software Engineering | May 2016
Semi-Supervised Verified Feedback Generation
Shalini Kaleeswaran, Anirudh Santhiar, Aditya Kanade, Sumit Gulwani
March 2016
Program Synthesis Using Stochastic Techniques
Communications of the ACM, Technical Perspective | February 2016, Vol 59(2): pp. 113
Programming by Examples
Tutorial at PLDI 2016 | January 2016
Programming by Examples (and its Applications in Data Wrangling)
Verification and Synthesis of Correct and Secure Systems | January 2016
Spreadsheet Programming using Examples
Keynote at SEMS 2016 | January 2016
Transforming Spreadsheet Data Types using Examples
Rishabh Singh, Sumit Gulwani
43rd Symposium on Principles of Programming Languages (POPL 2016) | January 2016
-
User Interaction Models for Disambiguation in Programming by Example
Mikaël Mayer, Gustavo Soares (gsoares), Maxim Grechkin, Vu Le, Mark Marron, Alex Polozov, Rishabh Singh, Ben Zorn, Sumit Gulwani
ACM Symposium on User Interface Software and Technology (UIST) 2015 | November 2015
Inductive Programming Meets the Real World
Sumit Gulwani, José Hernández-Orallo, Emanuel Kitzelmann, Stephen H. Muggleton, Ute Schmid, Ben Zorn
Communications of The ACM | November 2015
Programming by Examples: Applications, Ambiguity Resolutions, Approach
Lecture at UC-Berkeley | November 2015
Automating Grammar Comparison
Ravichandhran Madhavan, Mikaël Mayer, Sumit Gulwani, Viktor Kuncak
OOPSLA 2015 Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications | October 2015
FlashMeta: A Framework for Inductive Program Synthesis
Alex Polozov, Sumit Gulwani
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH) 2015 | October 2015
Applications of Inductive Programming in Data Wrangling
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Deductive Techniques for Synthesis from Inductive Specifications
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Microsoft FlashMeta SDK A Framework for Creating Inductive Synthesizers
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Programming by Examples (and its applications in Data Wrangling)
Lectures at Marktoberdorf Summer School, Aug 2015 | August 2015
FlashNormalize: Programming by Examples for Text Normalization
Dileep Kini, Sumit Gulwani
IJCAI'15 Proceedings of the 24th International Conference on Artificial Intelligence | July 2015
Personalized Mathematical Word Problem Generation
Alex Polozov, Eleanor O'Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
24th International Joint Conference on Artificial Intelligence (IJCAI) | July 2015
Automated Feedback and Recognition through Data Mining in Code Hunt
Daniel Perelman, Judith Bishop, Sumit Gulwani, Dan Grossman
MSR-TR-2015-57 | July 2015
Data Wrangling using Programming by Examples
Invited talk at ECOOP | July 2015
Predicting a Correct Program in Programming by Example
Rishabh Singh, Sumit Gulwani
27th International Conference on Computer Aided Verification (CAV 2015) | July 2015
27th International Conference on Computer Aided Verification (CAV 2015)
Building Bing Developer Assistant
Yi Wei, Nirupama Chandrasekaran, Sumit Gulwani, Youssef Hamadi
MSR-TR-2015-36 | May 2015
Compositional Program Synthesis from Natural Language and Examples
Mohammad Raza, Sumit Gulwani, Natasa Milic-Frayling
IJCAI 2015 | May 2015
Personalized Mathematical Word Problem Generation
Oleksandr Polozov, Eleanor O’Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
IJCAI 2015 | May 2015
A Framework for Automatically Generating Interactive Instructional Scaffolding
Eleanor O’Rourke, Erik Andersen, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
Automatic Game Progression Design through Analysis of Solution Features
Eric Butler, Erik Andersen, Adam M. Smith, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
How Can Automatic Feedback Help Students Construct Automata?
Loris D’Antoni, Dileep Kini, Rajeev Alur, Sumit Gulwani, Mahesh Viswanathan, Björn Hartmann
ACM Transactions on Computer-Human Interaction (TOCHI) - Special Issue on Online Learning at Scale | April 2015, Vol 22(2)
Mixed-Initiative Approaches to Global Editing in Slideware
Darren Edge, Sumit Gulwani, Natasa Milic-Frayling, Mohammad Raza, Reza Adhitya Saputra, Chao Wang, Koji Yatani
CHI 2015 Conference on Human Factors in Information Systems | April 2015
CHI 2015 Conference on Human Factors in Information Systems
Automatic Generation of Alternative Starting Positions for Simple Traditional Board Games
Umair Z. Ahmed, Krishnendu Chatterjee, Sumit Gulwani
AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | January 2015
ISBN: 0-262-51129-0
Automating Repetitive Tasks for the Masses
POPL '15 Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages | January 2015
Applications of Formal Methods to Data Wrangling and Education
Keynote at CBSoft 2015 | January 2015
Automating Repetitive Tasks for the Masses
Keynote at POPL 2015 | January 2015
Programming by Examples applied to Data Wrangling
Invited talk at SYNT 2015 | January 2015
-
Feedback Generation for Performance Problems in Introductory Programming Assignments
Sumit Gulwani, Ivan Radiček, Florian Zuleger
SIGSOFT/FSE'14, November 16 - 22 2014, Hong Kong, China | November 2014
LaSEWeb: Automating Search Strategies over Semi-structured Web Data
Alex Polozov, Sumit Gulwani
20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2014
Example-Based Learning in Computer-Aided STEM Education
Communications of the ACM | August 2014, Vol 57(8): pp. 70-80
Synthesis of Geometry Proof Problems
Chris Alvin, Sumit Gulwani, Rupak Majumdar, Supratik Mukhopadhyay
AAAI'14 Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence | July 2014
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
Invited talk at GECCO 2014, Genetic Programming Track | July 2014
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
GECCO'14, July 12-16, 2014, Vancouver, BC, Canada | July 2014
Programming by Example using Least General Generalizations
Mohammad Raza, Natasa Milic-Frayling, Sumit Gulwani
July 2014
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD'14, June 22-27, 2014, Snowbird, UT, USA | June 2014
Test-Driven Synthesis
Daniel Perelman, Sumit Gulwani, Dan Grossman, Peter Provost
PLDI '14, June 09-11, 2014, Edinburgh, United Kingdom | June 2014
FlashExtract: a framework for data extraction by examples
2014 Programming Language Design and Implementation | June 2014
DOI PDF PDF Publication Publication Publication Publication Video Video Project Project Project Project Project
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD '14 Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data | June 2014
FlashRelate: Extracting Relational Data from Semi-Structured Spreadsheets Using Examples
Daniel W. Barowy, Sumit Gulwani, Ted Hart, Ben Zorn
PLDI '15 Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation | April 2014
Distinguished Artifact Award
A Practical Framework for Constructing Structured Drawings
Salman Cheema, Sarah Buchanan, Sumit Gulwani, Joseph J. LaViola Jr.
IUI'14, February 24 - 27 2014, Haifa, Israel | February 2014
Problem Generation and Feedback Generation
Invited talk at ASSESS 2014 | January 2014
-
Solving Geometry Problems Using a Combination of Symbolic and Numerical Reasoning
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
19th International Conference, LPAR-19, Stellenbosch, South Africa, December 14-19, 2013. Proceedings | December 2013
A Colorful Approach to Text Processing by Example
Kuat Yessenov, Shubham Tulsiani, Aditya Menon, Robert C. Miller, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology | October 2013
Automated Grading of DFA constructions
Rajeev Alur, Loris D’Antoni, Sumit Gulwani, Dileep Kini
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Automatically Generating Problems and Solutions for Natural Deduction
Umair Z. Ahmed, Sumit Gulwani, Amey Karkare
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Recursive Program Synthesis
Aws Albarghouthi, Sumit Gulwani, Zachary Kincaid
CAV'13 Proceedings of the 25th international conference on Computer Aided Verification | July 2013
Automated Feedback Generation for Introductory Programming Assignments
Sumit Gulwani, Rishabh Singh
ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2013) | July 2013
Publication Publication Publication Publication Project Project
SmartSynth: synthesizing smartphone automation scripts from natural language
Vu Le, Sumit Gulwani, Zhendong Su
MobiSys'13 | June 2013
Static Analysis for Probabilistic Programs: Inferring Whole Program Properties from Finitely Many Paths
Sriram Sankaranarayanan, Aleksandar Chakarov, Sumit Gulwani
PLDI'13, June 16-19, 2013, Seattle, WA, USA | June 2013
Distinguished Paper Award
A Machine Learning Framework for Programming by Example
Aditya Krishna Menon, Omer Tamuz , Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | June 2013
Teaching and Learning Programming and Software Engineering via Interactive Gaming
Nikolai Tillmann, Jonathan "Peli" de Halleux, Tao Xie, Sumit Gulwani, Judith Bishop
ICSE '13 Proceedings of the 2013 International Conference on Software Engineering | May 2013
ISBN: 978-1-4673-3076-3
A Trace-based Framework for Analyzing and Synthesizing Educational Progressions
Sumit Gulwani, Erik Andersen, Zoran Popović
CHI 2013, April 27-May 2, 2013, Paris, France | April 2013
Biological Synthesis
April 2013
From Relational Verification to SIMD Loop Synthesis
Gilles Barthe , Juan Manuel Crespo , Sumit Gulwani, Cesar Kunz , Mark Marron
PPoPP '13 Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming | February 2013
Best Paper Award & CACM Highlight Nomination
Keyword Programming for TouchDevelop
Sumit Gulwani, Jonathan "Peli" de Halleux
Proceedings of the 11th international conference on Mobile systems, applications, and services | January 2013
-
Textual Features for Programming by Example
Aditya Krishna Menon, Omer Tamuz, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | September 2012
Continuity and Robustness of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
Cummunications of the ACM, Research Highlights | August 2012
Learning Semantic String Transformations from Examples
Rishabh Singh, Sumit Gulwani
PVLDB, 38th International Conference on Very Large Data Bases (VLDB 2012) | August 2012
Synthesizing Number Transformations from Input-Output Examples
Rishabh Singh, Sumit Gulwani
24th International Conference on Computer Aided Verification (CAV 2012) | July 2012
Type-Directed Completion of Partial Expressions
Daniel Perelman, Sumit Gulwani, Thomas Ball, Dan Grossman
PLDI'12, June 11-16, 2012, Beijing, China | June 2012
QuickDraw: Improving Drawing Experience for Geometric Diagrams
Salman Cheema, Sumit Gulwani, Joseph J. LaViola Jr.
CHI'12, May 5-10, 2012, Austin, Texas, USA | May 2012
Automatically Generating Algebra Problems
Sriram Rajamani, Sumit Gulwani, Sriram Rajamani
AAAI | April 2012
AAAI
Synthesis from Examples
February 2012, Vol 10(2)
Template-Based Program Verification and Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jerey S. Foster
International Journal on Software Tools for Technology Transfer | January 2012, Vol 15(5): pp. 497-518
Spreadsheet Data Manipulation using Examples
Sumit Gulwani, William R. Harris, Rishabh Singh
January 2012
Invited to CACM Research Highlights
Synthesis from Examples: Interaction Models and Algorithms
14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing | January 2012
-
Bound Analysis of Imperative Programs with the Size-change Abstraction
Florian Zuleger, Sumit Gulwani, Moritz Sinn, Helmut Veith
18th International Static Analysis Symposium, SAS 2011, Venice, Italy, September 14-16, 2011 | September 2011
Proving Programs Robust
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman, Sara Navidpour
ESEC/FSE'11, September 5-9, 2011, Szeged, Hungary | September 2011
Distinguished Paper Award, Invited to CACM Research Highlights
Path-based Inductive Synthesis for Program Inversion
Saurabh Srivastava, Sumit Gulwani, Swarat Chaudhuri, Jeffrey S. Foster
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesis of Loop-Free Programs
Sumit Gulwani, Susmit Jha, Ashish Tiwari, Ramarathnam Venkatesan
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesizing Geometry Constructions
Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Spreadsheet Table Transformations from Examples
Bill Harris, Sumit Gulwani
PLDI 2011 | June 2011
Automating String Processing in Spreadsheets using Input-Output Examples
PoPL'11, January 26-28, 2011, Austin, Texas, USA | January 2011
Most Influential POPL Paper Award
Publication Publication Publication Video Video Video Project Project
-
A Simple Inductive Synthesis Methodology and its Applications
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
OOPSLA/SPLASH'10, October 17-21, 2010, Reno/Tahoe, Nevada, USA | October 2010
The Reachability-Bound Problem
Sumit Gulwani, Florian Zuleger
PLDI'10, June 5-10, 2010, Toronto, Ontario, Canada | June 2010
Oracle-Guided Component-Based Program Synthesis
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICSE '10, May 2-8 2010, Cape Town, South Africa | May 2010
Synthesizing Switching Logic for Safety and Dwell-Time Requirement
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICCPS '10, April 13-15, 2010, Stockholm, Germany | April 2010
Continuity Analysis of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
From Program Verification to Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
Dimensions in Program Synthesis
PPDP '10 Hagenberg, Austria | January 2010
-
The Reachability-Bound Problem
MSR-TR-2009-146 | October 2009
Bound Analysis using Backward Symbolic Execution
Sumit Gulwani, Sudeep Juvekar
MSR-TR-2009-156 | October 2009
Art of Invariant Generation applied to Symbolic Bound Computation (Lecture Series)
Oregon Summer School | July 2009
Publication Publication Publication Publication Video Video Video Project
SPEED: Symbolic Complexity Bound Analysis
Computer Aided Verification, 21st International Conference, CAV 2009, Grenoble, France, June 26 - July 2, 2009 | June 2009
VS3: SMT Solvers for Program Verification
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
CAV '09 Proceedings of the 21st International Conference on Computer Aided Verification | June 2009
Control-flow Refinement and Progress Invariants for Bound Analysis
Sumit Gulwani, Sagar Jain, Eric Koskinen
PLDI '09 Proceedings of the 30th ACM SIGPLAN Conference on Programming Language Design and Implementation | June 2009
Program Verification using Templates over Predicate Abstraction
Saurabh Srivastava, Sumit Gulwani
PLDI'09, June 15-20, 2009, Dublin, Ireland | June 2009
Component Based Synthesis Applied to Bitvector Circuits
Sumit Gulwani, Ramarathnam Venkatesan
MSR-TR-2010-12 | April 2009
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
POPL'09, January 18-24, 2009, Savannah, Georgia, USA | January 2009
SPEED: Precise and Efficient Static Estimation of Program Computational Complexity
Sumit Gulwani, Krishna Mehra, Trishul Chilimbi
Principles of Programming Languages (POPL) | January 2009
-
Constraint-Based Invariant Inference Over Predicate Abstraction
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Synthesizing Switching Logic Using Constraint Solving
Ankur Taly, Sumit Gulwani, Ashish Tiwari
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Publication Publication Publication Publication Project Project
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
MSR-TR-2008-158 | October 2008
A Numerical Abstract Domain based on Expression Abstraction and Max Operator with Application in Timing Analysis
Bhargav S. Gulavani, Sumit Gulwani
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
Proving Conditional Termination
Byron Cook, Sumit Gulwani, Tal Lev-Ami, Andrey Rybalchenko, Mooly Sagiv
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Program Analysis as Constraint Solving
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Cover Algorithms and their Combination
Sumit Gulwani, Madan Musuvathi
ESOP'08/ETAPS'08 Proceedings of the Theory and Practice of Software, 17th European conference on Programming Languages and Systems | March 2008
ISBN: 3-540-78738-0 978-3-540-78738-9
Logical Abstract Interpretation
Lectures given in a graduate class on Static Program Analysis at UCLA and at IISc-Bangalore | March 2008
Lifting Abstract Interpreters to Quantified Logical Domains
Sumit Gulwani, Bill McCloskey, Ashish Tiwari
POPL'08, January 7-12, 2008, San Francisco, California, USA | January 2008
Constraint-Based Approach for Analysis of Hybrid Systems
Sumit Gulwani, Ashish Tiwari
Computer Aided Verification (CAV) | January 2008
Ranking Abstractions
Aziem Chawdhary, Byron Cook, Sumit Gulwani, Mooly Sagiv, Hongseok Yang
Programming Languages and Systems. ESOP 2008. Lecture Notes in Computer Science. | January 2008
-
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
MSR-TR-2007-111 | August 2007
An Abstract Domain for Analyzing Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
CAV'07 Proceedings of the 19th International Conference on Computer Aided Verification | July 2007
ISBN: 978-3-540-73367-6
Computing Procedure Summaries for Interprocedural Analysis
Sumit Gulwani, Ashish Tiwari
ESOP'07 Proceedings of the 16th European Symposium on Programming | March 2007
ISBN: 978-3-540-71314-2
Program Verification as Probabilistic Inference
Sumit Gulwani, Nebojsa Jojic
POPL'07 January 17-19, 2007, Nice, France. | January 2007
Assertion Checking Unified
Sumit Gulwani, Ashish Tiwari
8th International Conference, VMCAI 2007, Nice, France, January 14-16, 2007. | January 2007
-
Static Analysis of Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-160 | November 2006
Assertion Checking Unified
Sumit Gulwani, Asish Tiwari
MSR-TR-2006-99 | July 2006
Combining Abstract Interpreters
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-25 | March 2006
Assertion Checking over Combined Abstraction of Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-01 | January 2006
European Symposium on Programming 2006
-
Program Analysis using Random Interpretation
September 2005
PhD Thesis: PhD Dissertation, University of California, Berkeley | September 2005
ACM SIGPLAN Doctoral Dissertation Award
A Randomized Satisfiability Procedure for Arithmetic and Uninterpreted Function Symbols
Sumit Gulwani, George C. Necula
Information and Computation - Special issue: 19th international conference on automated deduction (CADE-19) | May 2005, Vol 199(1): pp. 107-131
Precise Interprocedural Analysis using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2005 | January 2005
-
Join Algorithms for the Theory of Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari, George C. Necula
FSTTCS'04 Proceedings of the 24th international conference on Foundations of Software Technology and Theoretical Computer Science | December 2004
Path-Sensitive Analysis for Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, George C. Necula
Static Analysis, 11th International Symposium, SAS 2004, Verona, Italy, August 26-28, 2004 | August 2004
Global Value Numbering using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2004 | January 2004
A Polynomial-Time Algorithm for Global Value Numbering
Sumit Gulwani, George C. Necula
Static Analysis Symposium (SAS), 2004 | January 2004
-
Discovering Affine Equalities using Random Interpretation
Sumit Gulwani, George C. Necula
POPL'03, January 15-17, 2003, New Orleans, Louisiana, USA | January 2003
-
WebCaL – A Domain Specific Language for Web Caching
Sumit Gulwani, Asha Tarachandani, Deepak Gupta, Dheeraj Sanghi, Luciano Porto Barreto , Charles Consel, Gilles Muller
Computer Communications | January 2000
Publications by Research Area
-
Execution-guided within-prompt search for programming-by-example
Gust Verbruggen, Ashish Tiwari, Mukul Singh, Vu Le, Sumit Gulwani
ICLR | April 2025
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with Feedback
Naman Gupta, Shashank Kirtania, Priyanshu Gupta, Krishna Kariya, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy, Arjun Radhakrishna, Sriram Rajamani, Gustavo Soares
October 2024
Preprint
METAREFLECTION: Learning Instructions for Language Agents using Past Reflections
Priyanshu Gupta, Shashank Kirtania, Ananya Singha, Sumit Gulwani, Arjun Radhakrishna, Sherry Shi, Gustavo Soares
EMNLP'24 | October 2024
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Let’s Fix this Together: Conversational Debugging with GitHub Copilot
Yasharth Bajpai, Bhavya Chopra, Param Biyani, Cagri Aslan, Sumit Gulwani, Dustin Coleman, Chris Parnin, Arjun Radhakrishna, Gustavo Soares
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | August 2024
Best Research Paper Award
RUBICON: Rubric-based Evaluation of Domain Specific Human-AI Conversations
Param Biyani, Yasharth Bajpai, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani
AIware: Proceedings of the 1st ACM International Conference on AI-Powered Software | July 2024
Best Paper Presentation Award
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation
Tung Phung, Victor-Alexandru Pădurean, Anjali Singh, Christopher Brooks, José Cambronero, Sumit Gulwani, Adish Singla, Gustavo Soares
International Learning Analytics and Knowledge Conference | March 2024
Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Bhavya Chopra, Yasharth Bajpai, Param Biyani, Gustavo Soares, Arjun Radhakrishna, Chris Parnin, Sumit Gulwani
NAACL: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing | February 2024
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMs
Ananya Singha, José Cambronero, Sumit Gulwani, Vu Le, Chris Parnin
Table Representation Learning Workshop at NeurIPS 2023 | December 2023
Grace: Language Models Meet Code Edits
Priyanshu Gupta, Avishree Khare, Yasharth Bajpai, Saikat Chakraborty, Sumit Gulwani, Aditya Kanade, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors
Tung Phung, Victor-Alexandru Padurean, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, Gustavo Soares
Conference on International Computing Education Research | September 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models
Tung Phung, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adisha Singla, Gustavo Soares
International Conference on Educational Data Mining | July 2023
CoWrangler: Recommender System for Data-Wrangling Scripts
Bhavya Chopra, Anna Fariha, Sumit Gulwani, Austin Z. Henley, Daniel Perelman, Mohammad Raza, Sherry Shi, Danny Simmons, Ashish Tiwari
SIGMOD | June 2023
From Words to Code: Harnessing Data for Program Synthesis from Natural Language
Anirudh Khatry, Joyce Cahoon, Jordan Henkel, Shaleen Deep, Venkatesh Emani, Avrilia Floratou, Sumit Gulwani, Vu Le, Mohammad Raza, Sherry Shi, Mukul Singh, Ashish Tiwari
May 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Overwatch: Learning Patterns in Code Edit Sequences
Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltos Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, Gustavo Soares, Ashish Tiwari
OOPSLA: Proceedings of the ACM on Programming Languages | October 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
Synchromesh: Reliable code generation from pre-trained language models
Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
ICLR 2022 | April 2022
Storytelling and Science
Titus Barik, Sumit Gulwani, Mario Juarez
March 2022
Multi-modal Program Inference: a Marriage of Pre-trained Language Models and Component-based Synthesis
Kia Rahmani, Mohammad Raza (moraza), Sumit Gulwani (sumitg), Vu Le (levu), Dan Morris (damorri), Arjun Radhakrishna (arradha), Gustavo Soares (gsoares), Ashish Tiwari (astiwar)
OOPSLA | October 2021
Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani, Alexandra Meliou
Proceedings of the 2021 International Conference on Management of Data | June 2021
An Integrated Approach of Deep Learning and Symbolic Analysis for Digital PDF Table Extraction
Mengshi Zhang, Daniel Perelman, Vu Le, Sumit Gulwani
International Conference on Pattern Recognition | October 2020
Feedback-Driven Semi-Supervised Synthesis of Program Transformations
Xiang Gao, Shraddha Barke, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani, Alan Leung, Nachi Nagappan, Ashish Tiwari
OOPSLA | October 2020
Programming by Rewards
Nagarajan Natarajan, Ajaykrishna Karthikeyan, Prateek Jain, Ivan Radicek, Sriram Rajamani, Sumit Gulwani, Johannes Gehrke
July 2020
Web data extraction using hybrid program synthesis: a combination of top-down and bottom-up inference
Mohammad Raza, Sumit Gulwani
SIGMOD (Special Interest Group on Management of Data) | June 2020
On the fly synthesis of edit suggestions
Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, Abhishek Udupa
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2019
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
Dependable Software Systems Engineering | Published by IOS Press | 2019
Learning Natural Programs from a Few Examples in Real-Time
Nagarajan Natarajan, Danny Simmons, Naren Datha (narend), Prateek Jain, Sumit Gulwani
AIStats | January 2019
Automated Clustering and Program Repair for Introductory Programming Assignments
Sumit Gulwani, Ivan Radicek, Florian Zuleger
PLDI | May 2018
Compilation Error Repair: For the Student Programs, From the Student Programs
Umair Ahmed, Pawan Kumar, Amey Karkare, Purushottam Kar, Sumit Gulwani
40th International Conference on Software Engineering (ICSE), Software Engineering Education and Training Track | February 2018
Disjunctive Program Synthesis: A Robust Approach to Programming by Example
Mohammad Raza, Sumit Gulwani
AAAI 2018 | February 2018
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Ashwin Kalyan, Abhishek Mohta, Alex Polozov, Dhruv Batra, Prateek Jain, Sumit Gulwani
6th International Conference on Learning Representations (ICLR) | January 2018
Automatic Diagnosis of Students’ Misconceptions in K-8 Mathematics
Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popovic, Erik Andersen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | January 2018
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
APLAS 2017 | October 2017
Program Synthesis
Sumit Gulwani, Alex Polozov, Rishabh Singh
Foundations and Trends in Programming Languages
Published by NOW | August 2017, Vol 4
Research for Practice: Programming by Examples
Research for Practice, CACM | July 2017, Vol 60: pp. 46-49
Learning to Learn Programs from Examples: Going Beyond Program Structure
Kevin Ellis, Sumit Gulwani
IJCAI 2017 | May 2017
Automated Data Extraction using Predictive Program Synthesis
Mohammad Raza, Sumit Gulwani
AAAI 2017 | February 2017
Automatic Generation of Alternative Starting Positions for Simple Traditional Board Games
Umair Z. Ahmed, Krishnendu Chatterjee, Sumit Gulwani
AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | January 2015
ISBN: 0-262-51129-0
Feedback Generation for Performance Problems in Introductory Programming Assignments
Sumit Gulwani, Ivan Radiček, Florian Zuleger
SIGSOFT/FSE'14, November 16 - 22 2014, Hong Kong, China | November 2014
Programming by Example using Least General Generalizations
Mohammad Raza, Natasa Milic-Frayling, Sumit Gulwani
July 2014
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD'14, June 22-27, 2014, Snowbird, UT, USA | June 2014
Solving Geometry Problems Using a Combination of Symbolic and Numerical Reasoning
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
19th International Conference, LPAR-19, Stellenbosch, South Africa, December 14-19, 2013. Proceedings | December 2013
Automated Grading of DFA constructions
Rajeev Alur, Loris D’Antoni, Sumit Gulwani, Dileep Kini
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Automatically Generating Problems and Solutions for Natural Deduction
Umair Z. Ahmed, Sumit Gulwani, Amey Karkare
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Recursive Program Synthesis
Aws Albarghouthi, Sumit Gulwani, Zachary Kincaid
CAV'13 Proceedings of the 25th international conference on Computer Aided Verification | July 2013
Spreadsheet Table Transformations from Examples
Bill Harris, Sumit Gulwani
PLDI 2011 | June 2011
A Simple Inductive Synthesis Methodology and its Applications
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
OOPSLA/SPLASH'10, October 17-21, 2010, Reno/Tahoe, Nevada, USA | October 2010
Oracle-Guided Component-Based Program Synthesis
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICSE '10, May 2-8 2010, Cape Town, South Africa | May 2010
Synthesizing Switching Logic for Safety and Dwell-Time Requirement
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICCPS '10, April 13-15, 2010, Stockholm, Germany | April 2010
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
CoWrangler: Recommender System for Data-Wrangling Scripts
Bhavya Chopra, Anna Fariha, Sumit Gulwani, Austin Z. Henley, Daniel Perelman, Mohammad Raza, Sherry Shi, Danny Simmons, Ashish Tiwari
SIGMOD | June 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
An Integrated Approach of Deep Learning and Symbolic Analysis for Digital PDF Table Extraction
Mengshi Zhang, Daniel Perelman, Vu Le, Sumit Gulwani
International Conference on Pattern Recognition | October 2020
ExTuNe: Explaining Tuple Non-conformance
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani
2020 International Conference on Management of Data | June 2020
Web data extraction using hybrid program synthesis: a combination of top-down and bottom-up inference
Mohammad Raza, Sumit Gulwani
SIGMOD (Special Interest Group on Management of Data) | June 2020
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
FlashProfile: Interactive Synthesis of Syntactic Profiles
Saswat Padhi, Prateek Jain, Daniel Perelman, Alex Polozov, Sumit Gulwani, Todd Milstein
arXiv preprint | September 2017, Vol arXiv:1709.05725
Automatic Game Progression Design through Analysis of Solution Features
Eric Butler, Erik Andersen, Adam M. Smith, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
A Framework for Automatically Generating Interactive Instructional Scaffolding
Eleanor O’Rourke, Erik Andersen, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
How Can Automatic Feedback Help Students Construct Automata?
Loris D’Antoni, Dileep Kini, Rajeev Alur, Sumit Gulwani, Mahesh Viswanathan, Björn Hartmann
ACM Transactions on Computer-Human Interaction (TOCHI) - Special Issue on Online Learning at Scale | April 2015, Vol 22(2)
Automatic Generation of Alternative Starting Positions for Simple Traditional Board Games
Umair Z. Ahmed, Krishnendu Chatterjee, Sumit Gulwani
AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | January 2015
ISBN: 0-262-51129-0
LaSEWeb: Automating Search Strategies over Semi-structured Web Data
Alex Polozov, Sumit Gulwani
20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2014
FlashRelate: Extracting Relational Data from Semi-Structured Spreadsheets Using Examples
Daniel W. Barowy, Sumit Gulwani, Ted Hart, Ben Zorn
PLDI '15 Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation | April 2014
Distinguished Artifact Award
A Trace-based Framework for Analyzing and Synthesizing Educational Progressions
Sumit Gulwani, Erik Andersen, Zoran Popović
CHI 2013, April 27-May 2, 2013, Paris, France | April 2013
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
MSR-TR-2008-158 | October 2008
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
Let’s Fix this Together: Conversational Debugging with GitHub Copilot
Yasharth Bajpai, Bhavya Chopra, Param Biyani, Cagri Aslan, Sumit Gulwani, Dustin Coleman, Chris Parnin, Arjun Radhakrishna, Gustavo Soares
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | August 2024
Best Research Paper Award
RUBICON: Rubric-based Evaluation of Domain Specific Human-AI Conversations
Param Biyani, Yasharth Bajpai, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani
AIware: Proceedings of the 1st ACM International Conference on AI-Powered Software | July 2024
Best Paper Presentation Award
Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Bhavya Chopra, Yasharth Bajpai, Param Biyani, Gustavo Soares, Arjun Radhakrishna, Chris Parnin, Sumit Gulwani
NAACL: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing | February 2024
Overwatch: Learning Patterns in Code Edit Sequences
Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltos Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, Gustavo Soares, Ashish Tiwari
OOPSLA: Proceedings of the ACM on Programming Languages | October 2022
reCode: A Lightweight Find-and-Replace Interaction in the IDE for Transforming Code by Example
Wode Ni, Joshua Sunshine, Vu Le, Sumit Gulwani, Titus Barik
UIST 2021 | October 2021
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
On the fly synthesis of edit suggestions
Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, Abhishek Udupa
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2019
Automatic Diagnosis of Students’ Misconceptions in K-8 Mathematics
Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popovic, Erik Andersen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | January 2018
User Interaction Models for Disambiguation in Programming by Example
Mikaël Mayer, Gustavo Soares (gsoares), Maxim Grechkin, Vu Le, Mark Marron, Alex Polozov, Rishabh Singh, Ben Zorn, Sumit Gulwani
ACM Symposium on User Interface Software and Technology (UIST) 2015 | November 2015
Personalized Mathematical Word Problem Generation
Alex Polozov, Eleanor O'Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
24th International Joint Conference on Artificial Intelligence (IJCAI) | July 2015
Mixed-Initiative Approaches to Global Editing in Slideware
Darren Edge, Sumit Gulwani, Natasa Milic-Frayling, Mohammad Raza, Reza Adhitya Saputra, Chao Wang, Koji Yatani
CHI 2015 Conference on Human Factors in Information Systems | April 2015
CHI 2015 Conference on Human Factors in Information Systems
Programming by Example using Least General Generalizations
Mohammad Raza, Natasa Milic-Frayling, Sumit Gulwani
July 2014
A Practical Framework for Constructing Structured Drawings
Salman Cheema, Sarah Buchanan, Sumit Gulwani, Joseph J. LaViola Jr.
IUI'14, February 24 - 27 2014, Haifa, Israel | February 2014
-
WebCaL – A Domain Specific Language for Web Caching
Sumit Gulwani, Asha Tarachandani, Deepak Gupta, Dheeraj Sanghi, Luciano Porto Barreto , Charles Consel, Gilles Muller
Computer Communications | January 2000
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Let’s Fix this Together: Conversational Debugging with GitHub Copilot
Yasharth Bajpai, Bhavya Chopra, Param Biyani, Cagri Aslan, Sumit Gulwani, Dustin Coleman, Chris Parnin, Arjun Radhakrishna, Gustavo Soares
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | August 2024
Best Research Paper Award
RUBICON: Rubric-based Evaluation of Domain Specific Human-AI Conversations
Param Biyani, Yasharth Bajpai, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani
AIware: Proceedings of the 1st ACM International Conference on AI-Powered Software | July 2024
Best Paper Presentation Award
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation
Tung Phung, Victor-Alexandru Pădurean, Anjali Singh, Christopher Brooks, José Cambronero, Sumit Gulwani, Adish Singla, Gustavo Soares
International Learning Analytics and Knowledge Conference | March 2024
Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Bhavya Chopra, Yasharth Bajpai, Param Biyani, Gustavo Soares, Arjun Radhakrishna, Chris Parnin, Sumit Gulwani
NAACL: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
Investigating Student Mistakes in Introductory Data Science Programming
Anjali Singh, Anna Fariha, Christopher Brooks, Gustavo Soares, Austin Z. Henley, Ashish Tiwari, Chethan M, Heeryung Choi, Sumit Gulwani
Technical Symposium on Computer Science Education | January 2024
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
Grace: Language Models Meet Code Edits
Priyanshu Gupta, Avishree Khare, Yasharth Bajpai, Saikat Chakraborty, Sumit Gulwani, Aditya Kanade, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
CoWrangler: Recommender System for Data-Wrangling Scripts
Bhavya Chopra, Anna Fariha, Sumit Gulwani, Austin Z. Henley, Daniel Perelman, Mohammad Raza, Sherry Shi, Danny Simmons, Ashish Tiwari
SIGMOD | June 2023
From Words to Code: Harnessing Data for Program Synthesis from Natural Language
Anirudh Khatry, Joyce Cahoon, Jordan Henkel, Shaleen Deep, Venkatesh Emani, Avrilia Floratou, Sumit Gulwani, Vu Le, Mohammad Raza, Sherry Shi, Mukul Singh, Ashish Tiwari
May 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
FlashFill++: Scaling Programming by Example by Cutting to the Chase
José Cambronero, Sumit Gulwani, Vu Le, Daniel Perelman, Arjun Radhakrishna, Clint Simon, Ashish Tiwari
Principles of Programming Languages | January 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Neurosymbolic Repair for Low-Code Formula Languages
Rohan Bavishi, Harshit Joshi, José Cambronero, Anna Fariha, Sumit Gulwani, Vu Le, Ivan Radicek, Ashish Tiwari
OOPSLA | December 2022
NL2Viz: Natural Language to Visualization via Constrained Syntax-Guided Synthesis
Zhengkai Wu, Vu Le, Ashish Tiwari, Sumit Gulwani, Arjun Radhakrishna, Ivan Radicek, Gustavo Soares, Xinyu Wang, Zhenwen Li, Tao Xie
FSE | November 2022
Overwatch: Learning Patterns in Code Edit Sequences
Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltos Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, Gustavo Soares, Ashish Tiwari
OOPSLA: Proceedings of the ACM on Programming Languages | October 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
AI-assisted Programming | IJCAI-ECAI 2022 Keynote by Sumit Gulwani
August 2022
PROSE Research Fellowship Program
Sumit Gulwani, Arjun Radhakrishna
May 2022
Shaping the future with: Sumit Gulwani
March 2022
Max Planck-Humboldt Medal 2021
Storytelling and Science
Titus Barik, Sumit Gulwani, Mario Juarez
March 2022
Semantic programming by example with pre-trained models
Gust Verbruggen, Vu Le, Sumit Gulwani
OOPSLA | October 2021
Multi-modal Program Inference: a Marriage of Pre-trained Language Models and Component-based Synthesis
Kia Rahmani, Mohammad Raza (moraza), Sumit Gulwani (sumitg), Vu Le (levu), Dan Morris (damorri), Arjun Radhakrishna (arradha), Gustavo Soares (gsoares), Ashish Tiwari (astiwar)
OOPSLA | October 2021
APIfix: Output-Oriented Program Synthesis for Combating Breaking Changes in Libraries
Xiang Gao, Arjun Radhakrishna, Gustavo Soares, Ridwan Shariffdeen, Sumit Gulwani, Abhik Roychoudhury
OOPSLA | September 2021
Can Program Synthesis be Used to Learn Merge Conflict Resolutions? An Empirical Analysis
Rangeet Pan, Vu Le, Nachi Nagappan, Sumit Gulwani, Shuvendu Lahiri, Mike Kaufman
2021 IEEE/ACM 43nd International Conference on Software Engineering (ICSE '21) | May 2021
Structure interpretation of text formats
Sumit Gulwani, Vu Le, Arjun Radhakrishna, Ivan Radicek, Mohammad Raza
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | November 2020
DOI PDF Author's Version Publication Publication Publication Video Project Project Project
An Integrated Approach of Deep Learning and Symbolic Analysis for Digital PDF Table Extraction
Mengshi Zhang, Daniel Perelman, Vu Le, Sumit Gulwani
International Conference on Pattern Recognition | October 2020
Feedback-Driven Semi-Supervised Synthesis of Program Transformations
Xiang Gao, Shraddha Barke, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani, Alan Leung, Nachi Nagappan, Ashish Tiwari
OOPSLA | October 2020
Programming by Rewards
Nagarajan Natarajan, Ajaykrishna Karthikeyan, Prateek Jain, Ivan Radicek, Sriram Rajamani, Sumit Gulwani, Johannes Gehrke
July 2020
ExTuNe: Explaining Tuple Non-conformance
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani
2020 International Conference on Management of Data | June 2020
Web data extraction using hybrid program synthesis: a combination of top-down and bottom-up inference
Mohammad Raza, Sumit Gulwani
SIGMOD (Special Interest Group on Management of Data) | June 2020
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
On the fly synthesis of edit suggestions
Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, Abhishek Udupa
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2019
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
Dependable Software Systems Engineering | Published by IOS Press | 2019
Learning Natural Programs from a Few Examples in Real-Time
Nagarajan Natarajan, Danny Simmons, Naren Datha (narend), Prateek Jain, Sumit Gulwani
AIStats | January 2019
FlashProfile: A Framework for Synthesizing Data Profiles
Saswat Padhi, Daniel Perelman, Prateek Jain, Alex Polozov, Sumit Gulwani, Todd Millstein
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH - OOPSLA) | November 2018
Automated Clustering and Program Repair for Introductory Programming Assignments
Sumit Gulwani, Ivan Radicek, Florian Zuleger
PLDI | May 2018
Compilation Error Repair: For the Student Programs, From the Student Programs
Umair Ahmed, Pawan Kumar, Amey Karkare, Purushottam Kar, Sumit Gulwani
40th International Conference on Software Engineering (ICSE), Software Engineering Education and Training Track | February 2018
Disjunctive Program Synthesis: A Robust Approach to Programming by Example
Mohammad Raza, Sumit Gulwani
AAAI 2018 | February 2018
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Ashwin Kalyan, Abhishek Mohta, Alex Polozov, Dhruv Batra, Prateek Jain, Sumit Gulwani
6th International Conference on Learning Representations (ICLR) | January 2018
Automatic Diagnosis of Students’ Misconceptions in K-8 Mathematics
Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popovic, Erik Andersen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | January 2018
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
APLAS 2017 | October 2017
FlashProfile: Interactive Synthesis of Syntactic Profiles
Saswat Padhi, Prateek Jain, Daniel Perelman, Alex Polozov, Sumit Gulwani, Todd Milstein
arXiv preprint | September 2017, Vol arXiv:1709.05725
Program Synthesis
Sumit Gulwani, Alex Polozov, Rishabh Singh
Foundations and Trends in Programming Languages
Published by NOW | August 2017, Vol 4
Research for Practice: Programming by Examples
Research for Practice, CACM | July 2017, Vol 60: pp. 46-49
Learning Syntactic Program Transformations from Examples
Reudismam Rolim, Gustavo Soares (gsoares), Loris D'Antoni, Alex Polozov, Sumit Gulwani, Rohit Gheyi, Bjoern Hartmann
39th International Conference on Software Engineering (ICSE) | May 2017
Learning to Learn Programs from Examples: Going Beyond Program Structure
Kevin Ellis, Sumit Gulwani
IJCAI 2017 | May 2017
Interactive Program Synthesis
Vu Le, Daniel Perelman, Alex Polozov, Mohammad Raza (moraza), Abhishek Udupa, Sumit Gulwani
arXiv preprint | March 2017, Vol arXiv:1703.03539
Ringer: Web Automation by Demonstration
Shaon Barman, Sarah Chasins, Ras Bodik, Sumit Gulwani
OOPSLA 2016 | November 2016
FIDEX: Filtering Spreadsheet Data using Examples
Xinyu Wang, Sumit Gulwani, Rishabh Singh
OOPSLA'16 October 25-30, 2016, The Netherlands | October 2016
Program Synthesis using Natural Language
Aditya Desai, Sumit Gulwani, Vineet Hingorani, Nidhi Jain, Amey Karkare, Mark Marron, Sailesh R, Subhajit Roy
ICSE '16, Austin, TX, USA | May 2016
Program Synthesis Using Natural Language
Aditya Desai , Sumit Gulwani, Vineet Hingorani , Nidhi Jain , Amey Karkare , Mark Marron, Sailesh R , Subhajit Roy
ICSE '16 Proceedings of the 38th International Conference on Software Engineering | May 2016
Semi-Supervised Verified Feedback Generation
Shalini Kaleeswaran, Anirudh Santhiar, Aditya Kanade, Sumit Gulwani
March 2016
Program Synthesis Using Stochastic Techniques
Communications of the ACM, Technical Perspective | February 2016, Vol 59(2): pp. 113
Spreadsheet Programming using Examples
Keynote at SEMS 2016 | January 2016
Programming by Examples
Tutorial at PLDI 2016 | January 2016
Programming by Examples (and its Applications in Data Wrangling)
Verification and Synthesis of Correct and Secure Systems | January 2016
Transforming Spreadsheet Data Types using Examples
Rishabh Singh, Sumit Gulwani
43rd Symposium on Principles of Programming Languages (POPL 2016) | January 2016
User Interaction Models for Disambiguation in Programming by Example
Mikaël Mayer, Gustavo Soares (gsoares), Maxim Grechkin, Vu Le, Mark Marron, Alex Polozov, Rishabh Singh, Ben Zorn, Sumit Gulwani
ACM Symposium on User Interface Software and Technology (UIST) 2015 | November 2015
Inductive Programming Meets the Real World
Sumit Gulwani, José Hernández-Orallo, Emanuel Kitzelmann, Stephen H. Muggleton, Ute Schmid, Ben Zorn
Communications of The ACM | November 2015
FlashMeta: A Framework for Inductive Program Synthesis
Alex Polozov, Sumit Gulwani
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH) 2015 | October 2015
Automating Grammar Comparison
Ravichandhran Madhavan, Mikaël Mayer, Sumit Gulwani, Viktor Kuncak
OOPSLA 2015 Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications | October 2015
Microsoft FlashMeta SDK A Framework for Creating Inductive Synthesizers
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Deductive Techniques for Synthesis from Inductive Specifications
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Applications of Inductive Programming in Data Wrangling
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Programming by Examples (and its applications in Data Wrangling)
Lectures at Marktoberdorf Summer School, Aug 2015 | August 2015
Personalized Mathematical Word Problem Generation
Alex Polozov, Eleanor O'Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
24th International Joint Conference on Artificial Intelligence (IJCAI) | July 2015
FlashNormalize: Programming by Examples for Text Normalization
Dileep Kini, Sumit Gulwani
IJCAI'15 Proceedings of the 24th International Conference on Artificial Intelligence | July 2015
Data Wrangling using Programming by Examples
Invited talk at ECOOP | July 2015
Automated Feedback and Recognition through Data Mining in Code Hunt
Daniel Perelman, Judith Bishop, Sumit Gulwani, Dan Grossman
MSR-TR-2015-57 | July 2015
Predicting a Correct Program in Programming by Example
Rishabh Singh, Sumit Gulwani
27th International Conference on Computer Aided Verification (CAV 2015) | July 2015
27th International Conference on Computer Aided Verification (CAV 2015)
Building Bing Developer Assistant
Yi Wei, Nirupama Chandrasekaran, Sumit Gulwani, Youssef Hamadi
MSR-TR-2015-36 | May 2015
Personalized Mathematical Word Problem Generation
Oleksandr Polozov, Eleanor O’Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
IJCAI 2015 | May 2015
Compositional Program Synthesis from Natural Language and Examples
Mohammad Raza, Sumit Gulwani, Natasa Milic-Frayling
IJCAI 2015 | May 2015
How Can Automatic Feedback Help Students Construct Automata?
Loris D’Antoni, Dileep Kini, Rajeev Alur, Sumit Gulwani, Mahesh Viswanathan, Björn Hartmann
ACM Transactions on Computer-Human Interaction (TOCHI) - Special Issue on Online Learning at Scale | April 2015, Vol 22(2)
Automating Repetitive Tasks for the Masses
POPL '15 Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages | January 2015
Automating Repetitive Tasks for the Masses
Keynote at POPL 2015 | January 2015
Programming by Examples applied to Data Wrangling
Invited talk at SYNT 2015 | January 2015
Applications of Formal Methods to Data Wrangling and Education
Keynote at CBSoft 2015 | January 2015
LaSEWeb: Automating Search Strategies over Semi-structured Web Data
Alex Polozov, Sumit Gulwani
20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2014
Example-Based Learning in Computer-Aided STEM Education
Communications of the ACM | August 2014, Vol 57(8): pp. 70-80
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
Invited talk at GECCO 2014, Genetic Programming Track | July 2014
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
GECCO'14, July 12-16, 2014, Vancouver, BC, Canada | July 2014
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD'14, June 22-27, 2014, Snowbird, UT, USA | June 2014
Test-Driven Synthesis
Daniel Perelman, Sumit Gulwani, Dan Grossman, Peter Provost
PLDI '14, June 09-11, 2014, Edinburgh, United Kingdom | June 2014
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD '14 Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data | June 2014
Problem Generation and Feedback Generation
Invited talk at ASSESS 2014 | January 2014
Solving Geometry Problems Using a Combination of Symbolic and Numerical Reasoning
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
19th International Conference, LPAR-19, Stellenbosch, South Africa, December 14-19, 2013. Proceedings | December 2013
A Colorful Approach to Text Processing by Example
Kuat Yessenov, Shubham Tulsiani, Aditya Menon, Robert C. Miller, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology | October 2013
Automatically Generating Problems and Solutions for Natural Deduction
Umair Z. Ahmed, Sumit Gulwani, Amey Karkare
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Recursive Program Synthesis
Aws Albarghouthi, Sumit Gulwani, Zachary Kincaid
CAV'13 Proceedings of the 25th international conference on Computer Aided Verification | July 2013
Automated Feedback Generation for Introductory Programming Assignments
Sumit Gulwani, Rishabh Singh
ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2013) | July 2013
Publication Publication Publication Publication Project Project
SmartSynth: synthesizing smartphone automation scripts from natural language
Vu Le, Sumit Gulwani, Zhendong Su
MobiSys'13 | June 2013
Static Analysis for Probabilistic Programs: Inferring Whole Program Properties from Finitely Many Paths
Sriram Sankaranarayanan, Aleksandar Chakarov, Sumit Gulwani
PLDI'13, June 16-19, 2013, Seattle, WA, USA | June 2013
Distinguished Paper Award
A Machine Learning Framework for Programming by Example
Aditya Krishna Menon, Omer Tamuz , Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | June 2013
Teaching and Learning Programming and Software Engineering via Interactive Gaming
Nikolai Tillmann, Jonathan "Peli" de Halleux, Tao Xie, Sumit Gulwani, Judith Bishop
ICSE '13 Proceedings of the 2013 International Conference on Software Engineering | May 2013
ISBN: 978-1-4673-3076-3
Biological Synthesis
April 2013
From Relational Verification to SIMD Loop Synthesis
Gilles Barthe , Juan Manuel Crespo , Sumit Gulwani, Cesar Kunz , Mark Marron
PPoPP '13 Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming | February 2013
Best Paper Award & CACM Highlight Nomination
Keyword Programming for TouchDevelop
Sumit Gulwani, Jonathan "Peli" de Halleux
Proceedings of the 11th international conference on Mobile systems, applications, and services | January 2013
Textual Features for Programming by Example
Aditya Krishna Menon, Omer Tamuz, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | September 2012
Learning Semantic String Transformations from Examples
Rishabh Singh, Sumit Gulwani
PVLDB, 38th International Conference on Very Large Data Bases (VLDB 2012) | August 2012
Synthesizing Number Transformations from Input-Output Examples
Rishabh Singh, Sumit Gulwani
24th International Conference on Computer Aided Verification (CAV 2012) | July 2012
Type-Directed Completion of Partial Expressions
Daniel Perelman, Sumit Gulwani, Thomas Ball, Dan Grossman
PLDI'12, June 11-16, 2012, Beijing, China | June 2012
Template-Based Program Verification and Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jerey S. Foster
International Journal on Software Tools for Technology Transfer | January 2012, Vol 15(5): pp. 497-518
Spreadsheet Data Manipulation using Examples
Sumit Gulwani, William R. Harris, Rishabh Singh
January 2012
Invited to CACM Research Highlights
Spreadsheet Table Transformations from Examples
Bill Harris, Sumit Gulwani
PLDI 2011 | June 2011
The Reachability-Bound Problem
Sumit Gulwani, Florian Zuleger
PLDI'10, June 5-10, 2010, Toronto, Ontario, Canada | June 2010
Bound Analysis using Backward Symbolic Execution
Sumit Gulwani, Sudeep Juvekar
MSR-TR-2009-156 | October 2009
Program Verification using Templates over Predicate Abstraction
Saurabh Srivastava, Sumit Gulwani
PLDI'09, June 15-20, 2009, Dublin, Ireland | June 2009
Control-flow Refinement and Progress Invariants for Bound Analysis
Sumit Gulwani, Sagar Jain, Eric Koskinen
PLDI '09 Proceedings of the 30th ACM SIGPLAN Conference on Programming Language Design and Implementation | June 2009
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
POPL'09, January 18-24, 2009, Savannah, Georgia, USA | January 2009
SPEED: Precise and Efficient Static Estimation of Program Computational Complexity
Sumit Gulwani, Krishna Mehra, Trishul Chilimbi
Principles of Programming Languages (POPL) | January 2009
Constraint-Based Invariant Inference Over Predicate Abstraction
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Proving Conditional Termination
Byron Cook, Sumit Gulwani, Tal Lev-Ami, Andrey Rybalchenko, Mooly Sagiv
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Program Analysis as Constraint Solving
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Logical Abstract Interpretation
Lectures given in a graduate class on Static Program Analysis at UCLA and at IISc-Bangalore | March 2008
Constraint-Based Approach for Analysis of Hybrid Systems
Sumit Gulwani, Ashish Tiwari
Computer Aided Verification (CAV) | January 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
MSR-TR-2007-111 | August 2007
An Abstract Domain for Analyzing Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
CAV'07 Proceedings of the 19th International Conference on Computer Aided Verification | July 2007
ISBN: 978-3-540-73367-6
Computing Procedure Summaries for Interprocedural Analysis
Sumit Gulwani, Ashish Tiwari
ESOP'07 Proceedings of the 16th European Symposium on Programming | March 2007
ISBN: 978-3-540-71314-2
Assertion Checking Unified
Sumit Gulwani, Ashish Tiwari
8th International Conference, VMCAI 2007, Nice, France, January 14-16, 2007. | January 2007
Static Analysis of Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-160 | November 2006
Assertion Checking Unified
Sumit Gulwani, Asish Tiwari
MSR-TR-2006-99 | July 2006
Combining Abstract Interpreters
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-25 | March 2006
Program Analysis using Random Interpretation
September 2005
PhD Thesis: PhD Dissertation, University of California, Berkeley | September 2005
ACM SIGPLAN Doctoral Dissertation Award
Precise Interprocedural Analysis using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2005 | January 2005
Discovering Affine Equalities using Random Interpretation
Sumit Gulwani, George C. Necula
POPL'03, January 15-17, 2003, New Orleans, Louisiana, USA | January 2003
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
Storytelling and Science
Titus Barik, Sumit Gulwani, Mario Juarez
March 2022
-
Building Bing Developer Assistant
Yi Wei, Nirupama Chandrasekaran, Sumit Gulwani, Youssef Hamadi
MSR-TR-2015-36 | May 2015
LaSEWeb: Automating Search Strategies over Semi-structured Web Data
Alex Polozov, Sumit Gulwani
20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2014
-
Interactive Program Synthesis
Vu Le, Daniel Perelman, Alex Polozov, Mohammad Raza (moraza), Abhishek Udupa, Sumit Gulwani
arXiv preprint | March 2017, Vol arXiv:1703.03539
FIDEX: Filtering Spreadsheet Data using Examples
Xinyu Wang, Sumit Gulwani, Rishabh Singh
OOPSLA'16 October 25-30, 2016, The Netherlands | October 2016
Programming by Examples: Applications, Algorithms, and Ambiguity Resolution
Invited talk at IJCAR 2016 | June 2016
Programming by Examples: Applications, Ambiguity Resolutions, Approach
Lecture at UC-Berkeley | November 2015
Automatic Generation of Alternative Starting Positions for Simple Traditional Board Games
Umair Z. Ahmed, Krishnendu Chatterjee, Sumit Gulwani
AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | January 2015
ISBN: 0-262-51129-0
Automating Repetitive Tasks for the Masses
POPL '15 Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages | January 2015
Feedback Generation for Performance Problems in Introductory Programming Assignments
Sumit Gulwani, Ivan Radiček, Florian Zuleger
SIGSOFT/FSE'14, November 16 - 22 2014, Hong Kong, China | November 2014
Synthesis of Geometry Proof Problems
Chris Alvin, Sumit Gulwani, Rupak Majumdar, Supratik Mukhopadhyay
AAAI'14 Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence | July 2014
FlashExtract: a framework for data extraction by examples
2014 Programming Language Design and Implementation | June 2014
DOI PDF PDF Publication Publication Publication Publication Video Video Project Project Project Project Project
A Practical Framework for Constructing Structured Drawings
Salman Cheema, Sarah Buchanan, Sumit Gulwani, Joseph J. LaViola Jr.
IUI'14, February 24 - 27 2014, Haifa, Israel | February 2014
Recursive Program Synthesis
Aws Albarghouthi, Sumit Gulwani, Zachary Kincaid
CAV'13 Proceedings of the 25th international conference on Computer Aided Verification | July 2013
SmartSynth: synthesizing smartphone automation scripts from natural language
Vu Le, Sumit Gulwani, Zhendong Su
MobiSys'13 | June 2013
A Trace-based Framework for Analyzing and Synthesizing Educational Progressions
Sumit Gulwani, Erik Andersen, Zoran Popović
CHI 2013, April 27-May 2, 2013, Paris, France | April 2013
Biological Synthesis
April 2013
Continuity and Robustness of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
Cummunications of the ACM, Research Highlights | August 2012
Synthesis from Examples
February 2012, Vol 10(2)
Synthesis from Examples: Interaction Models and Algorithms
14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing | January 2012
Bound Analysis of Imperative Programs with the Size-change Abstraction
Florian Zuleger, Sumit Gulwani, Moritz Sinn, Helmut Veith
18th International Static Analysis Symposium, SAS 2011, Venice, Italy, September 14-16, 2011 | September 2011
Proving Programs Robust
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman, Sara Navidpour
ESEC/FSE'11, September 5-9, 2011, Szeged, Hungary | September 2011
Distinguished Paper Award, Invited to CACM Research Highlights
Path-based Inductive Synthesis for Program Inversion
Saurabh Srivastava, Sumit Gulwani, Swarat Chaudhuri, Jeffrey S. Foster
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesis of Loop-Free Programs
Sumit Gulwani, Susmit Jha, Ashish Tiwari, Ramarathnam Venkatesan
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesizing Geometry Constructions
Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Automating String Processing in Spreadsheets using Input-Output Examples
PoPL'11, January 26-28, 2011, Austin, Texas, USA | January 2011
Most Influential POPL Paper Award
Publication Publication Publication Video Video Video Project Project
Continuity Analysis of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
From Program Verification to Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
Dimensions in Program Synthesis
PPDP '10 Hagenberg, Austria | January 2010
Art of Invariant Generation applied to Symbolic Bound Computation (Lecture Series)
Oregon Summer School | July 2009
Publication Publication Publication Publication Video Video Video Project
VS3: SMT Solvers for Program Verification
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
CAV '09 Proceedings of the 21st International Conference on Computer Aided Verification | June 2009
SPEED: Symbolic Complexity Bound Analysis
Computer Aided Verification, 21st International Conference, CAV 2009, Grenoble, France, June 26 - July 2, 2009 | June 2009
Program Verification using Templates over Predicate Abstraction
Saurabh Srivastava, Sumit Gulwani
PLDI'09, June 15-20, 2009, Dublin, Ireland | June 2009
SPEED: Precise and Efficient Static Estimation of Program Computational Complexity
Sumit Gulwani, Krishna Mehra, Trishul Chilimbi
Principles of Programming Languages (POPL) | January 2009
Synthesizing Switching Logic Using Constraint Solving
Ankur Taly, Sumit Gulwani, Ashish Tiwari
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Publication Publication Publication Publication Project Project
Constraint-Based Invariant Inference Over Predicate Abstraction
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
A Numerical Abstract Domain based on Expression Abstraction and Max Operator with Application in Timing Analysis
Bhargav S. Gulavani, Sumit Gulwani
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Program Analysis as Constraint Solving
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Cover Algorithms and their Combination
Sumit Gulwani, Madan Musuvathi
ESOP'08/ETAPS'08 Proceedings of the Theory and Practice of Software, 17th European conference on Programming Languages and Systems | March 2008
ISBN: 3-540-78738-0 978-3-540-78738-9
Lifting Abstract Interpreters to Quantified Logical Domains
Sumit Gulwani, Bill McCloskey, Ashish Tiwari
POPL'08, January 7-12, 2008, San Francisco, California, USA | January 2008
Ranking Abstractions
Aziem Chawdhary, Byron Cook, Sumit Gulwani, Mooly Sagiv, Hongseok Yang
Programming Languages and Systems. ESOP 2008. Lecture Notes in Computer Science. | January 2008
Constraint-Based Approach for Analysis of Hybrid Systems
Sumit Gulwani, Ashish Tiwari
Computer Aided Verification (CAV) | January 2008
An Abstract Domain for Analyzing Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
CAV'07 Proceedings of the 19th International Conference on Computer Aided Verification | July 2007
ISBN: 978-3-540-73367-6
Program Verification as Probabilistic Inference
Sumit Gulwani, Nebojsa Jojic
POPL'07 January 17-19, 2007, Nice, France. | January 2007
Assertion Checking Unified
Sumit Gulwani, Ashish Tiwari
8th International Conference, VMCAI 2007, Nice, France, January 14-16, 2007. | January 2007
Assertion Checking over Combined Abstraction of Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-01 | January 2006
European Symposium on Programming 2006
A Randomized Satisfiability Procedure for Arithmetic and Uninterpreted Function Symbols
Sumit Gulwani, George C. Necula
Information and Computation - Special issue: 19th international conference on automated deduction (CADE-19) | May 2005, Vol 199(1): pp. 107-131
Join Algorithms for the Theory of Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari, George C. Necula
FSTTCS'04 Proceedings of the 24th international conference on Foundations of Software Technology and Theoretical Computer Science | December 2004
Path-Sensitive Analysis for Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, George C. Necula
Static Analysis, 11th International Symposium, SAS 2004, Verona, Italy, August 26-28, 2004 | August 2004
Global Value Numbering using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2004 | January 2004
A Polynomial-Time Algorithm for Global Value Numbering
Sumit Gulwani, George C. Necula
Static Analysis Symposium (SAS), 2004 | January 2004
Discovering Affine Equalities using Random Interpretation
Sumit Gulwani, George C. Necula
POPL'03, January 15-17, 2003, New Orleans, Louisiana, USA | January 2003
-
QuickDraw: Improving Drawing Experience for Geometric Diagrams
Salman Cheema, Sumit Gulwani, Joseph J. LaViola Jr.
CHI'12, May 5-10, 2012, Austin, Texas, USA | May 2012
Automatically Generating Algebra Problems
Sriram Rajamani, Sumit Gulwani, Sriram Rajamani
AAAI | April 2012
AAAI
Synthesizing Geometry Constructions
Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
-
Program Synthesis Using Natural Language
Aditya Desai , Sumit Gulwani, Vineet Hingorani , Nidhi Jain , Amey Karkare , Mark Marron, Sailesh R , Subhajit Roy
ICSE '16 Proceedings of the 38th International Conference on Software Engineering | May 2016
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD '14 Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data | June 2014
-
The Reachability-Bound Problem
MSR-TR-2009-146 | October 2009
Component Based Synthesis Applied to Bitvector Circuits
Sumit Gulwani, Ramarathnam Venkatesan
MSR-TR-2010-12 | April 2009
Publications by Type
-
WebCaL – A Domain Specific Language for Web Caching
Sumit Gulwani, Asha Tarachandani, Deepak Gupta, Dheeraj Sanghi, Luciano Porto Barreto , Charles Consel, Gilles Muller
Computer Communications | January 2000
Execution-guided within-prompt search for programming-by-example
Gust Verbruggen, Ashish Tiwari, Mukul Singh, Vu Le, Sumit Gulwani
ICLR | April 2025
METAREFLECTION: Learning Instructions for Language Agents using Past Reflections
Priyanshu Gupta, Shashank Kirtania, Ananya Singha, Sumit Gulwani, Arjun Radhakrishna, Sherry Shi, Gustavo Soares
EMNLP'24 | October 2024
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Let’s Fix this Together: Conversational Debugging with GitHub Copilot
Yasharth Bajpai, Bhavya Chopra, Param Biyani, Cagri Aslan, Sumit Gulwani, Dustin Coleman, Chris Parnin, Arjun Radhakrishna, Gustavo Soares
IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) | August 2024
Best Research Paper Award
RUBICON: Rubric-based Evaluation of Domain Specific Human-AI Conversations
Param Biyani, Yasharth Bajpai, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani
AIware: Proceedings of the 1st ACM International Conference on AI-Powered Software | July 2024
Best Paper Presentation Award
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation
Tung Phung, Victor-Alexandru Pădurean, Anjali Singh, Christopher Brooks, José Cambronero, Sumit Gulwani, Adish Singla, Gustavo Soares
International Learning Analytics and Knowledge Conference | March 2024
Exploring Interaction Patterns for Debugging: Enhancing Conversational Capabilities of AI-assistants
Bhavya Chopra, Yasharth Bajpai, Param Biyani, Gustavo Soares, Arjun Radhakrishna, Chris Parnin, Sumit Gulwani
NAACL: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing | February 2024
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
Investigating Student Mistakes in Introductory Data Science Programming
Anjali Singh, Anna Fariha, Christopher Brooks, Gustavo Soares, Austin Z. Henley, Ashish Tiwari, Chethan M, Heeryung Choi, Sumit Gulwani
Technical Symposium on Computer Science Education | January 2024
Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMs
Ananya Singha, José Cambronero, Sumit Gulwani, Vu Le, Chris Parnin
Table Representation Learning Workshop at NeurIPS 2023 | December 2023
Grace: Language Models Meet Code Edits
Priyanshu Gupta, Avishree Khare, Yasharth Bajpai, Saikat Chakraborty, Sumit Gulwani, Aditya Kanade, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari
ESEC/FSE 2023: Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering | November 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors
Tung Phung, Victor-Alexandru Padurean, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, Gustavo Soares
Conference on International Computing Education Research | September 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models
Tung Phung, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adisha Singla, Gustavo Soares
International Conference on Educational Data Mining | July 2023
CoWrangler: Recommender System for Data-Wrangling Scripts
Bhavya Chopra, Anna Fariha, Sumit Gulwani, Austin Z. Henley, Daniel Perelman, Mohammad Raza, Sherry Shi, Danny Simmons, Ashish Tiwari
SIGMOD | June 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
FlashFill++: Scaling Programming by Example by Cutting to the Chase
José Cambronero, Sumit Gulwani, Vu Le, Daniel Perelman, Arjun Radhakrishna, Clint Simon, Ashish Tiwari
Principles of Programming Languages | January 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Neurosymbolic Repair for Low-Code Formula Languages
Rohan Bavishi, Harshit Joshi, José Cambronero, Anna Fariha, Sumit Gulwani, Vu Le, Ivan Radicek, Ashish Tiwari
OOPSLA | December 2022
NL2Viz: Natural Language to Visualization via Constrained Syntax-Guided Synthesis
Zhengkai Wu, Vu Le, Ashish Tiwari, Sumit Gulwani, Arjun Radhakrishna, Ivan Radicek, Gustavo Soares, Xinyu Wang, Zhenwen Li, Tao Xie
FSE | November 2022
Overwatch: Learning Patterns in Code Edit Sequences
Yuhao Zhang, Yasharth Bajpai, Priyanshu Gupta, Ameya Ketkar, Miltos Allamanis, Titus Barik, Sumit Gulwani, Arjun Radhakrishna, Mohammad Raza, Gustavo Soares, Ashish Tiwari
OOPSLA: Proceedings of the ACM on Programming Languages | October 2022
AI-assisted Programming | IJCAI-ECAI 2022 Keynote by Sumit Gulwani
August 2022
Synchromesh: Reliable code generation from pre-trained language models
Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
ICLR 2022 | April 2022
reCode: A Lightweight Find-and-Replace Interaction in the IDE for Transforming Code by Example
Wode Ni, Joshua Sunshine, Vu Le, Sumit Gulwani, Titus Barik
UIST 2021 | October 2021
Semantic programming by example with pre-trained models
Gust Verbruggen, Vu Le, Sumit Gulwani
OOPSLA | October 2021
Multi-modal Program Inference: a Marriage of Pre-trained Language Models and Component-based Synthesis
Kia Rahmani, Mohammad Raza (moraza), Sumit Gulwani (sumitg), Vu Le (levu), Dan Morris (damorri), Arjun Radhakrishna (arradha), Gustavo Soares (gsoares), Ashish Tiwari (astiwar)
OOPSLA | October 2021
APIfix: Output-Oriented Program Synthesis for Combating Breaking Changes in Libraries
Xiang Gao, Arjun Radhakrishna, Gustavo Soares, Ridwan Shariffdeen, Sumit Gulwani, Abhik Roychoudhury
OOPSLA | September 2021
Can Program Synthesis be Used to Learn Merge Conflict Resolutions? An Empirical Analysis
Rangeet Pan, Vu Le, Nachi Nagappan, Sumit Gulwani, Shuvendu Lahiri, Mike Kaufman
2021 IEEE/ACM 43nd International Conference on Software Engineering (ICSE '21) | May 2021
Structure interpretation of text formats
Sumit Gulwani, Vu Le, Arjun Radhakrishna, Ivan Radicek, Mohammad Raza
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | November 2020
DOI PDF Author's Version Publication Publication Publication Video Project Project Project
An Integrated Approach of Deep Learning and Symbolic Analysis for Digital PDF Table Extraction
Mengshi Zhang, Daniel Perelman, Vu Le, Sumit Gulwani
International Conference on Pattern Recognition | October 2020
Feedback-Driven Semi-Supervised Synthesis of Program Transformations
Xiang Gao, Shraddha Barke, Arjun Radhakrishna, Gustavo Soares, Sumit Gulwani, Alan Leung, Nachi Nagappan, Ashish Tiwari
OOPSLA | October 2020
ExTuNe: Explaining Tuple Non-conformance
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani
2020 International Conference on Management of Data | June 2020
Web data extraction using hybrid program synthesis: a combination of top-down and bottom-up inference
Mohammad Raza, Sumit Gulwani
SIGMOD (Special Interest Group on Management of Data) | June 2020
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
On the fly synthesis of edit suggestions
Anders Miltner, Sumit Gulwani, Vu Le, Alan Leung, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari, Abhishek Udupa
Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2019
Learning Natural Programs from a Few Examples in Real-Time
Nagarajan Natarajan, Danny Simmons, Naren Datha (narend), Prateek Jain, Sumit Gulwani
AIStats | January 2019
FlashProfile: A Framework for Synthesizing Data Profiles
Saswat Padhi, Daniel Perelman, Prateek Jain, Alex Polozov, Sumit Gulwani, Todd Millstein
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH - OOPSLA) | November 2018
Automated Clustering and Program Repair for Introductory Programming Assignments
Sumit Gulwani, Ivan Radicek, Florian Zuleger
PLDI | May 2018
Compilation Error Repair: For the Student Programs, From the Student Programs
Umair Ahmed, Pawan Kumar, Amey Karkare, Purushottam Kar, Sumit Gulwani
40th International Conference on Software Engineering (ICSE), Software Engineering Education and Training Track | February 2018
Disjunctive Program Synthesis: A Robust Approach to Programming by Example
Mohammad Raza, Sumit Gulwani
AAAI 2018 | February 2018
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Ashwin Kalyan, Abhishek Mohta, Alex Polozov, Dhruv Batra, Prateek Jain, Sumit Gulwani
6th International Conference on Learning Representations (ICLR) | January 2018
Automatic Diagnosis of Students’ Misconceptions in K-8 Mathematics
Molly Q Feldman, Ji Yong Cho, Monica Ong, Sumit Gulwani, Zoran Popovic, Erik Andersen
2018 ACM Conference on Human Factors in Computing Systems (CHI) | January 2018
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
APLAS 2017 | October 2017
Learning Syntactic Program Transformations from Examples
Reudismam Rolim, Gustavo Soares (gsoares), Loris D'Antoni, Alex Polozov, Sumit Gulwani, Rohit Gheyi, Bjoern Hartmann
39th International Conference on Software Engineering (ICSE) | May 2017
Learning to Learn Programs from Examples: Going Beyond Program Structure
Kevin Ellis, Sumit Gulwani
IJCAI 2017 | May 2017
Automated Data Extraction using Predictive Program Synthesis
Mohammad Raza, Sumit Gulwani
AAAI 2017 | February 2017
Ringer: Web Automation by Demonstration
Shaon Barman, Sarah Chasins, Ras Bodik, Sumit Gulwani
OOPSLA 2016 | November 2016
FIDEX: Filtering Spreadsheet Data using Examples
Xinyu Wang, Sumit Gulwani, Rishabh Singh
OOPSLA'16 October 25-30, 2016, The Netherlands | October 2016
Programming by Examples: Applications, Algorithms, and Ambiguity Resolution
Invited talk at IJCAR 2016 | June 2016
Program Synthesis using Natural Language
Aditya Desai, Sumit Gulwani, Vineet Hingorani, Nidhi Jain, Amey Karkare, Mark Marron, Sailesh R, Subhajit Roy
ICSE '16, Austin, TX, USA | May 2016
Program Synthesis Using Natural Language
Aditya Desai , Sumit Gulwani, Vineet Hingorani , Nidhi Jain , Amey Karkare , Mark Marron, Sailesh R , Subhajit Roy
ICSE '16 Proceedings of the 38th International Conference on Software Engineering | May 2016
Semi-Supervised Verified Feedback Generation
Shalini Kaleeswaran, Anirudh Santhiar, Aditya Kanade, Sumit Gulwani
March 2016
Spreadsheet Programming using Examples
Keynote at SEMS 2016 | January 2016
Programming by Examples
Tutorial at PLDI 2016 | January 2016
Programming by Examples (and its Applications in Data Wrangling)
Verification and Synthesis of Correct and Secure Systems | January 2016
Transforming Spreadsheet Data Types using Examples
Rishabh Singh, Sumit Gulwani
43rd Symposium on Principles of Programming Languages (POPL 2016) | January 2016
User Interaction Models for Disambiguation in Programming by Example
Mikaël Mayer, Gustavo Soares (gsoares), Maxim Grechkin, Vu Le, Mark Marron, Alex Polozov, Rishabh Singh, Ben Zorn, Sumit Gulwani
ACM Symposium on User Interface Software and Technology (UIST) 2015 | November 2015
Programming by Examples: Applications, Ambiguity Resolutions, Approach
Lecture at UC-Berkeley | November 2015
Inductive Programming Meets the Real World
Sumit Gulwani, José Hernández-Orallo, Emanuel Kitzelmann, Stephen H. Muggleton, Ute Schmid, Ben Zorn
Communications of The ACM | November 2015
FlashMeta: A Framework for Inductive Program Synthesis
Alex Polozov, Sumit Gulwani
ACM SIGPLAN conference on Systems, Programming, Languages and Applications: Software for Humanity (SPLASH) 2015 | October 2015
Automating Grammar Comparison
Ravichandhran Madhavan, Mikaël Mayer, Sumit Gulwani, Viktor Kuncak
OOPSLA 2015 Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications | October 2015
Microsoft FlashMeta SDK A Framework for Creating Inductive Synthesizers
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Deductive Techniques for Synthesis from Inductive Specifications
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Applications of Inductive Programming in Data Wrangling
Talks at Dagstuhl seminar on Approaches and Applications of Inductive Programming, Oct 2015 | October 2015
Programming by Examples (and its applications in Data Wrangling)
Lectures at Marktoberdorf Summer School, Aug 2015 | August 2015
Personalized Mathematical Word Problem Generation
Alex Polozov, Eleanor O'Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
24th International Joint Conference on Artificial Intelligence (IJCAI) | July 2015
FlashNormalize: Programming by Examples for Text Normalization
Dileep Kini, Sumit Gulwani
IJCAI'15 Proceedings of the 24th International Conference on Artificial Intelligence | July 2015
Data Wrangling using Programming by Examples
Invited talk at ECOOP | July 2015
Predicting a Correct Program in Programming by Example
Rishabh Singh, Sumit Gulwani
27th International Conference on Computer Aided Verification (CAV 2015) | July 2015
27th International Conference on Computer Aided Verification (CAV 2015)
Personalized Mathematical Word Problem Generation
Oleksandr Polozov, Eleanor O’Rourke, Adam M. Smith, Luke Zettlemoyer, Sumit Gulwani, Zoran Popović
IJCAI 2015 | May 2015
Compositional Program Synthesis from Natural Language and Examples
Mohammad Raza, Sumit Gulwani, Natasa Milic-Frayling
IJCAI 2015 | May 2015
Automatic Game Progression Design through Analysis of Solution Features
Eric Butler, Erik Andersen, Adam M. Smith, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
A Framework for Automatically Generating Interactive Instructional Scaffolding
Eleanor O’Rourke, Erik Andersen, Sumit Gulwani, Zoran Popović
CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea | April 2015
Mixed-Initiative Approaches to Global Editing in Slideware
Darren Edge, Sumit Gulwani, Natasa Milic-Frayling, Mohammad Raza, Reza Adhitya Saputra, Chao Wang, Koji Yatani
CHI 2015 Conference on Human Factors in Information Systems | April 2015
CHI 2015 Conference on Human Factors in Information Systems
Automatic Generation of Alternative Starting Positions for Simple Traditional Board Games
Umair Z. Ahmed, Krishnendu Chatterjee, Sumit Gulwani
AAAI'15 Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence | January 2015
ISBN: 0-262-51129-0
Automating Repetitive Tasks for the Masses
POPL '15 Proceedings of the 42nd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages | January 2015
Automating Repetitive Tasks for the Masses
Keynote at POPL 2015 | January 2015
Programming by Examples applied to Data Wrangling
Invited talk at SYNT 2015 | January 2015
Applications of Formal Methods to Data Wrangling and Education
Keynote at CBSoft 2015 | January 2015
Feedback Generation for Performance Problems in Introductory Programming Assignments
Sumit Gulwani, Ivan Radiček, Florian Zuleger
SIGSOFT/FSE'14, November 16 - 22 2014, Hong Kong, China | November 2014
LaSEWeb: Automating Search Strategies over Semi-structured Web Data
Alex Polozov, Sumit Gulwani
20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2014
Synthesis of Geometry Proof Problems
Chris Alvin, Sumit Gulwani, Rupak Majumdar, Supratik Mukhopadhyay
AAAI'14 Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence | July 2014
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
Invited talk at GECCO 2014, Genetic Programming Track | July 2014
Applications of Program Synthesis to End-User Programming and Intelligent Tutoring Systems
GECCO'14, July 12-16, 2014, Vancouver, BC, Canada | July 2014
Programming by Example using Least General Generalizations
Mohammad Raza, Natasa Milic-Frayling, Sumit Gulwani
July 2014
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD'14, June 22-27, 2014, Snowbird, UT, USA | June 2014
Test-Driven Synthesis
Daniel Perelman, Sumit Gulwani, Dan Grossman, Peter Provost
PLDI '14, June 09-11, 2014, Edinburgh, United Kingdom | June 2014
FlashExtract: a framework for data extraction by examples
2014 Programming Language Design and Implementation | June 2014
DOI PDF PDF Publication Publication Publication Publication Video Video Project Project Project Project Project
NLyze: Interactive Programming by Natural Language for SpreadSheet Data Analysis and Manipulation
Sumit Gulwani, Mark Marron
SIGMOD '14 Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data | June 2014
FlashRelate: Extracting Relational Data from Semi-Structured Spreadsheets Using Examples
Daniel W. Barowy, Sumit Gulwani, Ted Hart, Ben Zorn
PLDI '15 Proceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation | April 2014
Distinguished Artifact Award
A Practical Framework for Constructing Structured Drawings
Salman Cheema, Sarah Buchanan, Sumit Gulwani, Joseph J. LaViola Jr.
IUI'14, February 24 - 27 2014, Haifa, Israel | February 2014
Problem Generation and Feedback Generation
Invited talk at ASSESS 2014 | January 2014
Solving Geometry Problems Using a Combination of Symbolic and Numerical Reasoning
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
19th International Conference, LPAR-19, Stellenbosch, South Africa, December 14-19, 2013. Proceedings | December 2013
A Colorful Approach to Text Processing by Example
Kuat Yessenov, Shubham Tulsiani, Aditya Menon, Robert C. Miller, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology | October 2013
Automated Grading of DFA constructions
Rajeev Alur, Loris D’Antoni, Sumit Gulwani, Dileep Kini
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Automatically Generating Problems and Solutions for Natural Deduction
Umair Z. Ahmed, Sumit Gulwani, Amey Karkare
IJCAI '13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence | August 2013
ISBN: 978-1-57735-633-2
Recursive Program Synthesis
Aws Albarghouthi, Sumit Gulwani, Zachary Kincaid
CAV'13 Proceedings of the 25th international conference on Computer Aided Verification | July 2013
Automated Feedback Generation for Introductory Programming Assignments
Sumit Gulwani, Rishabh Singh
ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2013) | July 2013
Publication Publication Publication Publication Project Project
SmartSynth: synthesizing smartphone automation scripts from natural language
Vu Le, Sumit Gulwani, Zhendong Su
MobiSys'13 | June 2013
Static Analysis for Probabilistic Programs: Inferring Whole Program Properties from Finitely Many Paths
Sriram Sankaranarayanan, Aleksandar Chakarov, Sumit Gulwani
PLDI'13, June 16-19, 2013, Seattle, WA, USA | June 2013
Distinguished Paper Award
A Machine Learning Framework for Programming by Example
Aditya Krishna Menon, Omer Tamuz , Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | June 2013
Teaching and Learning Programming and Software Engineering via Interactive Gaming
Nikolai Tillmann, Jonathan "Peli" de Halleux, Tao Xie, Sumit Gulwani, Judith Bishop
ICSE '13 Proceedings of the 2013 International Conference on Software Engineering | May 2013
ISBN: 978-1-4673-3076-3
A Trace-based Framework for Analyzing and Synthesizing Educational Progressions
Sumit Gulwani, Erik Andersen, Zoran Popović
CHI 2013, April 27-May 2, 2013, Paris, France | April 2013
Biological Synthesis
April 2013
From Relational Verification to SIMD Loop Synthesis
Gilles Barthe , Juan Manuel Crespo , Sumit Gulwani, Cesar Kunz , Mark Marron
PPoPP '13 Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming | February 2013
Best Paper Award & CACM Highlight Nomination
Keyword Programming for TouchDevelop
Sumit Gulwani, Jonathan "Peli" de Halleux
Proceedings of the 11th international conference on Mobile systems, applications, and services | January 2013
Textual Features for Programming by Example
Aditya Krishna Menon, Omer Tamuz, Sumit Gulwani, Butler Lampson, Adam Tauman Kalai
Proceedings of the 30th International Conference on Machine Learning (ICML), 2013 | September 2012
Continuity and Robustness of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
Cummunications of the ACM, Research Highlights | August 2012
Learning Semantic String Transformations from Examples
Rishabh Singh, Sumit Gulwani
PVLDB, 38th International Conference on Very Large Data Bases (VLDB 2012) | August 2012
Synthesizing Number Transformations from Input-Output Examples
Rishabh Singh, Sumit Gulwani
24th International Conference on Computer Aided Verification (CAV 2012) | July 2012
Type-Directed Completion of Partial Expressions
Daniel Perelman, Sumit Gulwani, Thomas Ball, Dan Grossman
PLDI'12, June 11-16, 2012, Beijing, China | June 2012
QuickDraw: Improving Drawing Experience for Geometric Diagrams
Salman Cheema, Sumit Gulwani, Joseph J. LaViola Jr.
CHI'12, May 5-10, 2012, Austin, Texas, USA | May 2012
Automatically Generating Algebra Problems
Sriram Rajamani, Sumit Gulwani, Sriram Rajamani
AAAI | April 2012
AAAI
Spreadsheet Data Manipulation using Examples
Sumit Gulwani, William R. Harris, Rishabh Singh
January 2012
Invited to CACM Research Highlights
Synthesis from Examples: Interaction Models and Algorithms
14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing | January 2012
Bound Analysis of Imperative Programs with the Size-change Abstraction
Florian Zuleger, Sumit Gulwani, Moritz Sinn, Helmut Veith
18th International Static Analysis Symposium, SAS 2011, Venice, Italy, September 14-16, 2011 | September 2011
Proving Programs Robust
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman, Sara Navidpour
ESEC/FSE'11, September 5-9, 2011, Szeged, Hungary | September 2011
Distinguished Paper Award, Invited to CACM Research Highlights
Path-based Inductive Synthesis for Program Inversion
Saurabh Srivastava, Sumit Gulwani, Swarat Chaudhuri, Jeffrey S. Foster
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesis of Loop-Free Programs
Sumit Gulwani, Susmit Jha, Ashish Tiwari, Ramarathnam Venkatesan
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Synthesizing Geometry Constructions
Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari
PLDI'11, June 4-8, 2011, San Jose, California, USA | June 2011
Spreadsheet Table Transformations from Examples
Bill Harris, Sumit Gulwani
PLDI 2011 | June 2011
Automating String Processing in Spreadsheets using Input-Output Examples
PoPL'11, January 26-28, 2011, Austin, Texas, USA | January 2011
Most Influential POPL Paper Award
Publication Publication Publication Video Video Video Project Project
A Simple Inductive Synthesis Methodology and its Applications
Shachar Itzhaky, Sumit Gulwani, Neil Immerman, Mooly Sagiv
OOPSLA/SPLASH'10, October 17-21, 2010, Reno/Tahoe, Nevada, USA | October 2010
The Reachability-Bound Problem
Sumit Gulwani, Florian Zuleger
PLDI'10, June 5-10, 2010, Toronto, Ontario, Canada | June 2010
Oracle-Guided Component-Based Program Synthesis
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICSE '10, May 2-8 2010, Cape Town, South Africa | May 2010
Synthesizing Switching Logic for Safety and Dwell-Time Requirement
Susmit Jha, Sumit Gulwani, Sanjit A. Seshia, Ashish Tiwari
ICCPS '10, April 13-15, 2010, Stockholm, Germany | April 2010
Continuity Analysis of Programs
Swarat Chaudhuri, Sumit Gulwani, Roberto Lublinerman
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
From Program Verification to Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
POPL'10, January 17-23, 2010, Madrid, Spain | January 2010
Dimensions in Program Synthesis
PPDP '10 Hagenberg, Austria | January 2010
Art of Invariant Generation applied to Symbolic Bound Computation (Lecture Series)
Oregon Summer School | July 2009
Publication Publication Publication Publication Video Video Video Project
VS3: SMT Solvers for Program Verification
Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster
CAV '09 Proceedings of the 21st International Conference on Computer Aided Verification | June 2009
SPEED: Symbolic Complexity Bound Analysis
Computer Aided Verification, 21st International Conference, CAV 2009, Grenoble, France, June 26 - July 2, 2009 | June 2009
Program Verification using Templates over Predicate Abstraction
Saurabh Srivastava, Sumit Gulwani
PLDI'09, June 15-20, 2009, Dublin, Ireland | June 2009
Control-flow Refinement and Progress Invariants for Bound Analysis
Sumit Gulwani, Sagar Jain, Eric Koskinen
PLDI '09 Proceedings of the 30th ACM SIGPLAN Conference on Programming Language Design and Implementation | June 2009
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
POPL'09, January 18-24, 2009, Savannah, Georgia, USA | January 2009
SPEED: Precise and Efficient Static Estimation of Program Computational Complexity
Sumit Gulwani, Krishna Mehra, Trishul Chilimbi
Principles of Programming Languages (POPL) | January 2009
Synthesizing Switching Logic Using Constraint Solving
Ankur Taly, Sumit Gulwani, Ashish Tiwari
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Publication Publication Publication Publication Project Project
Constraint-Based Invariant Inference Over Predicate Abstraction
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation | December 2008
Proving Conditional Termination
Byron Cook, Sumit Gulwani, Tal Lev-Ami, Andrey Rybalchenko, Mooly Sagiv
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
A Numerical Abstract Domain based on Expression Abstraction and Max Operator with Application in Timing Analysis
Bhargav S. Gulavani, Sumit Gulwani
CAV '08 Proceedings of the 20th international conference on Computer Aided Verification | July 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Program Analysis as Constraint Solving
Sumit Gulwani, Saurabh Srivastava, Ramarathnam Venkatesan
PLDI'08, June 7-13, 2008, Tucson, Arizona, USA | June 2008
Cover Algorithms and their Combination
Sumit Gulwani, Madan Musuvathi
ESOP'08/ETAPS'08 Proceedings of the Theory and Practice of Software, 17th European conference on Programming Languages and Systems | March 2008
ISBN: 3-540-78738-0 978-3-540-78738-9
Logical Abstract Interpretation
Lectures given in a graduate class on Static Program Analysis at UCLA and at IISc-Bangalore | March 2008
Lifting Abstract Interpreters to Quantified Logical Domains
Sumit Gulwani, Bill McCloskey, Ashish Tiwari
POPL'08, January 7-12, 2008, San Francisco, California, USA | January 2008
Ranking Abstractions
Aziem Chawdhary, Byron Cook, Sumit Gulwani, Mooly Sagiv, Hongseok Yang
Programming Languages and Systems. ESOP 2008. Lecture Notes in Computer Science. | January 2008
Constraint-Based Approach for Analysis of Hybrid Systems
Sumit Gulwani, Ashish Tiwari
Computer Aided Verification (CAV) | January 2008
An Abstract Domain for Analyzing Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
CAV'07 Proceedings of the 19th International Conference on Computer Aided Verification | July 2007
ISBN: 978-3-540-73367-6
Computing Procedure Summaries for Interprocedural Analysis
Sumit Gulwani, Ashish Tiwari
ESOP'07 Proceedings of the 16th European Symposium on Programming | March 2007
ISBN: 978-3-540-71314-2
Program Verification as Probabilistic Inference
Sumit Gulwani, Nebojsa Jojic
POPL'07 January 17-19, 2007, Nice, France. | January 2007
Assertion Checking Unified
Sumit Gulwani, Ashish Tiwari
8th International Conference, VMCAI 2007, Nice, France, January 14-16, 2007. | January 2007
Precise Interprocedural Analysis using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2005 | January 2005
Join Algorithms for the Theory of Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari, George C. Necula
FSTTCS'04 Proceedings of the 24th international conference on Foundations of Software Technology and Theoretical Computer Science | December 2004
Path-Sensitive Analysis for Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, George C. Necula
Static Analysis, 11th International Symposium, SAS 2004, Verona, Italy, August 26-28, 2004 | August 2004
Global Value Numbering using Random Interpretation
Sumit Gulwani, George C. Necula
Proceedings of the Principles of Programming Languages (POPL), 2004 | January 2004
A Polynomial-Time Algorithm for Global Value Numbering
Sumit Gulwani, George C. Necula
Static Analysis Symposium (SAS), 2004 | January 2004
Discovering Affine Equalities using Random Interpretation
Sumit Gulwani, George C. Necula
POPL'03, January 15-17, 2003, New Orleans, Louisiana, USA | January 2003
-
Microsoft New Future of Work Report 2024
Jenna Butler, Mihaela Vorvoreanu, Rebecca Janssen, Abigail Sellen, Nicole Immorlica, Adam Troy, Advait Sarkar, Alex Farach, Alex Chouldechova, Alexandra Olteanu, Alexia Cambon, Arjun Radhakrishna, Asta Roseway, Ben Zorn, Brent Hecht, Daniel G. Goldstein, Dhruv Joshi, Ed Cutrell, Emre Kiciman, Gonzalo Ramos, Gustavo Soares, Hanna Wallach, Ian Drosos, Jack Williams (johnwilliams), Jacki O'Neill, Jake Hofman, Jaime Teevan, Javier Hernandez, Jennifer Wortman Vaughan, Jina Suh, John Tang, Justin Edwards, Kalika Bali, Kori Inkpen, Krishna Madhavan, Laylah Bulman, Leon Reicherts, Lev Tankelevitch, Longqi Yang, Martez Mott, Millicent Ochieng, Mercy Muchai, Nancy Baym, Najeeb Abdulhamid, Nicolai Marquardt, Ken Hinckley, Michael Bentley, Dave Brown, Hugo Romat, Nathalie Henry Riche, Samuel Maina, Shamsi Iqbal, Siân Lindley, Stephanie Nyairo, Su Lin Blodgett, Sumit Gulwani, Sunayana Sitaram, Vu Le
MSR-TR-2024-56 | December 2024
Published by Microsoft
Automated Feedback and Recognition through Data Mining in Code Hunt
Daniel Perelman, Judith Bishop, Sumit Gulwani, Dan Grossman
MSR-TR-2015-57 | July 2015
Building Bing Developer Assistant
Yi Wei, Nirupama Chandrasekaran, Sumit Gulwani, Youssef Hamadi
MSR-TR-2015-36 | May 2015
The Reachability-Bound Problem
MSR-TR-2009-146 | October 2009
Bound Analysis using Backward Symbolic Execution
Sumit Gulwani, Sudeep Juvekar
MSR-TR-2009-156 | October 2009
Component Based Synthesis Applied to Bitvector Circuits
Sumit Gulwani, Ramarathnam Venkatesan
MSR-TR-2010-12 | April 2009
A Combination Framework for Tracking Partition Sizes
Sumit Gulwani, Tal Lev-Ami, Mooly Sagiv
MSR-TR-2008-158 | October 2008
Inferring Locks for Atomic Sections
Sigmund Cherem, Trishul Chilimbi, Sumit Gulwani
MSR-TR-2007-111 | August 2007
Static Analysis of Heap-Manipulating Low-Level Software
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-160 | November 2006
Assertion Checking Unified
Sumit Gulwani, Asish Tiwari
MSR-TR-2006-99 | July 2006
Combining Abstract Interpreters
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-25 | March 2006
Assertion Checking over Combined Abstraction of Linear Arithmetic and Uninterpreted Functions
Sumit Gulwani, Ashish Tiwari
MSR-TR-2006-01 | January 2006
European Symposium on Programming 2006
-
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Storytelling and Science
Titus Barik, Sumit Gulwani, Mario Juarez
March 2022
Conformance Constraint Discovery: Measuring Trust in Data-Driven Systems
Anna Fariha, Ashish Tiwari, Arjun Radhakrishna, Sumit Gulwani, Alexandra Meliou
Proceedings of the 2021 International Conference on Management of Data | June 2021
FlashProfile: Interactive Synthesis of Syntactic Profiles
Saswat Padhi, Prateek Jain, Daniel Perelman, Alex Polozov, Sumit Gulwani, Todd Milstein
arXiv preprint | September 2017, Vol arXiv:1709.05725
Research for Practice: Programming by Examples
Research for Practice, CACM | July 2017, Vol 60: pp. 46-49
Interactive Program Synthesis
Vu Le, Daniel Perelman, Alex Polozov, Mohammad Raza (moraza), Abhishek Udupa, Sumit Gulwani
arXiv preprint | March 2017, Vol arXiv:1703.03539
Program Synthesis Using Stochastic Techniques
Communications of the ACM, Technical Perspective | February 2016, Vol 59(2): pp. 113
How Can Automatic Feedback Help Students Construct Automata?
Loris D’Antoni, Dileep Kini, Rajeev Alur, Sumit Gulwani, Mahesh Viswanathan, Björn Hartmann
ACM Transactions on Computer-Human Interaction (TOCHI) - Special Issue on Online Learning at Scale | April 2015, Vol 22(2)
Example-Based Learning in Computer-Aided STEM Education
Communications of the ACM | August 2014, Vol 57(8): pp. 70-80
Template-Based Program Verification and Program Synthesis
Saurabh Srivastava, Sumit Gulwani, Jerey S. Foster
International Journal on Software Tools for Technology Transfer | January 2012, Vol 15(5): pp. 497-518
A Randomized Satisfiability Procedure for Arithmetic and Uninterpreted Function Symbols
Sumit Gulwani, George C. Necula
Information and Computation - Special issue: 19th international conference on automated deduction (CADE-19) | May 2005, Vol 199(1): pp. 107-131
-
STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with Feedback
Naman Gupta, Shashank Kirtania, Priyanshu Gupta, Krishna Kariya, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy, Arjun Radhakrishna, Sriram Rajamani, Gustavo Soares
October 2024
Preprint
From Words to Code: Harnessing Data for Program Synthesis from Natural Language
Anirudh Khatry, Joyce Cahoon, Jordan Henkel, Shaleen Deep, Venkatesh Emani, Avrilia Floratou, Sumit Gulwani, Vu Le, Mohammad Raza, Sherry Shi, Mukul Singh, Ashish Tiwari
May 2023
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
Programming by Rewards
Nagarajan Natarajan, Ajaykrishna Karthikeyan, Prateek Jain, Ivan Radicek, Sriram Rajamani, Sumit Gulwani, Johannes Gehrke
July 2020
-
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
-
PROSE Research Fellowship Program
Sumit Gulwani, Arjun Radhakrishna
May 2022
Shaping the future with: Sumit Gulwani
March 2022
Max Planck-Humboldt Medal 2021
Synthesis from Examples
February 2012, Vol 10(2)
-
Programming by Examples: PL meets ML
Sumit Gulwani, Prateek Jain
Dependable Software Systems Engineering | Published by IOS Press | 2019
-
Program Synthesis
Sumit Gulwani, Alex Polozov, Rishabh Singh
Foundations and Trends in Programming Languages
Published by NOW | August 2017, Vol 4
-
Program Analysis using Random Interpretation
September 2005
PhD Thesis: PhD Dissertation, University of California, Berkeley | September 2005
ACM SIGPLAN Doctoral Dissertation Award