One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
Gust Verbruggen
Researcher
Publications
Publications by Year
-
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
-
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
-
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
Publications by Research Area
-
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
-
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
-
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022
Publications by Type
-
One-to-many testing for code generation from (just) natural language
Mansi Uniyal, Mukul Singh, Gust Verbruggen, Sumit Gulwani, Vu Le
Findings of EMNLP 2024 | September 2024
RAR: Retrieval Augmented Retrieval for Code Generation in Low Resource Languages
Avik Dutta, Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
EMNLP 2024 | September 2024
Tabularis Revilio: Converting Text to Tables
Mukul Singh, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management | August 2024
Semantically Aligned Question and Code Generation for Automated Insight Generation
Ananya Singha, Bhavya Chopra, Anirudh Khatry, Sumit Gulwani, Austin Henley, Vu Le, Chris Parnin, Mukul Singh, Gust Verbruggen
LLM4Code Workshop at ICSE '24 | April 2024
Best Paper
FLAME: A Small Language Model for Spreadsheet Formulas
Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radicek, Gust Verbruggen
AAAI | February 2024
PyDex: Repairing Bugs in Introductory Python Assignments using LLMs
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
Object-oriented Programming, Systems, Languages, and Applications (OOPSLA) | January 2024
TSTR: Target Similarity Tuning Meets the Real World
Anirudh Khatry, Sumit Gulwani, Priyanshu Gupta, Vu Le, Ananya Singha, Mukul Singh, Gust Verbruggen
Findings of EMNLP 2023 | November 2023
CODEFUSION: A Pre-trained Diffusion Model for Code Generation
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen, Carina Negreanu
EMNLP 2023 | November 2023
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Elnaz Nouri, Mohammad Raza, Gust Verbruggen
50th International Conference on Very Large Data Bases (VLDB 24) | October 2023
EmFore: Online Learning of Email Folder Classification Rules
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management | October 2023
Demonstration of CORNET: Learning Spreadsheet Formatting Rules by Example
Mukul Singh, José Cambronero, Carina Negreanu, Sumit Gulwani, Gust Verbruggen
49th International Conference on Very Large Data Bases - Demo Track | August 2023
Cornet: Learning Table Formatting Rules By Example
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Mohammad Raza, Gust Verbruggen
49th International Conference on Very Large Data Bases | May 2023
Personalized Action Suggestions in Low-Code Automation Platforms
Saksham Gupta, Gust Verbruggen, Mukul Singh, Sumit Gulwani, Vu Le
International Conference on Software Engineering (ICSE) 2023 - Industry Track | December 2022
-
EmFORE: Learning Email Folder Classification Rules by Demonstration
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
38th Annual AAAI Conference on Artificial Intelligence - Demo Track | March 2024, pp. 23835-23837
Assessing GPT4-V on Structured Reasoning Tasks
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Gust Verbruggen
Preprint | December 2023
DataVinci: Learning Syntactic and Semantic String Repairs
Mukul Singh, José Cambronero, Sumit Gulwani, Vu Le, Carina Negreanu, Gust Verbruggen
Preprint | August 2023
-
Repair Is Nearly Generation: Multilingual Program Repair with LLMs
Harshit Joshi, José Cambronero, Sumit Gulwani, Vu Le, Ivan Radicek, Gust Verbruggen
February 2023
Published by: AAAI | February 2023
-
Repairing Bugs in Python Assignments using Large Language Models
Jialu Zhang, José Cambronero, Sumit Gulwani, Vu Le, Ruzica Piskac, Gustavo Soares, Gust Verbruggen
September 2022