Data&AI Science

AdaptivePaste: Intelligent Copy-Paste in IDE

Xiaoyu Liu, Jinu Jang, Neel Sundaresan, Miltos Allamanis, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication

InferFix: End-to-End Program Repair with LLMs over Retrieval-Augmented Prompts

Matthew Jin, Syed Shahriar, Michele Tufano, Xin Shi, Shuai Lu, Neel Sundaresan, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication Github

DeepDev-PERF: A Deep Learning-Based Approach for Improving Software Performance

Spandan Garg, Roshanak Zilouchian Moghaddam, Colin Clement, Neel Sundaresan, Chen Wu

ESEC/FSE | August 2022

Publication

Exploring and Evaluating Personalized Models for Code Generation

Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy, Colin Clement, Neel Sundaresan, Michele Tufano

Foundations of Software Engineering | August 2022

Publication Project

Generating Accurate Assert Statements for Unit Test Cases using Pretrained Transformers

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Neel Sundaresan

2022 IEEE/ACM International Conference on Automation of Software Test (AST) | May 2022

Publication Publication Publication Project

Learning to Reduce False Positives in Analytic Bug Detectors

Anant Kharkar, Roshanak Zilouchian Moghaddam, Matthew Jin, Xiaoyu Liu, Xin Shi, Colin Clement, Neel Sundaresan

2022 International Conference on Software Engineering | May 2022

PDF

Methods2Test: A dataset of focal methods mapped to test cases

Michele Tufano, Shao Kun Deng, Neel Sundaresan, Alexey Svyatkovskiy

2022 International Conference on Mining Software Repositories (MSR) | May 2022

Publication Publication Project

Generating Examples From CLI Usage: Can Transformers Help?

Roshanak Zilouchian Moghaddam, Spandan Garg, Colin Clement, Yevhen Mohylevskyy, Neel Sundaresan

KDD 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication Project Project

Training and Evaluating a Jupyter Notebook Data Science Assistant

Shubham Chandel, Colin Clement, Guillermo Serrato, Neel Sundaresan

February 2022

Preprint

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Colin Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

2021 Empirical Methods in Natural Language Processing | October 2021

PDF Project Project

MergeBERT: Program Merge Conflict Resolution via Neural Transformers

Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri

August 2021

Publication Project Project

Distilling Transformers for Neural Cross-Domain Search

Colin Clement, Chen Wu, Dawn Drain, Neel Sundaresan

August 2021

Preprint

PerfLens: A Data-Driven Performance Bug Detection and Fix Platform

Spandan Garg, Roshanak Zilouchian Moghaddam, Neel Sundaresan, Chen Wu, Spandan Garg

SOAP ’21 | June 2021

Publication DOI

Unit Test Case Generation with Transformers and Focal Context

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, Neel Sundaresan

May 2021

PDF Project Project

DeepMerge: Learning to Merge Programs

Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri

May 2021

Publication Project

Generating Bug-Fixes Using Pretrained Transformers

Dawn Drain, Chen Wu, Alexey Svyatkovskiy, Neel Sundaresan

PLDI 2021 | April 2021

Publication Project

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang (姜大昕), Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong (YIMING), Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu

February 2021

Publication Github Project Project Project

PyMT5: multi-mode translation of natural language and Python code with transformers

Colin Clement, Dawn Drain, Jonathan Timcheck, Alexey Svyatkovskiy, Neel Sundaresan

2020 Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication Publication Publication Project

GraphCodeBERT: Pre-training Code Representations with Data Flow

Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang (姜大昕), Ming Zhou

September 2020

PDF Publication Project Project

Pythia: AI-assisted Code Completion System

Alexey Svyatkovskiy, Ying Zhao, Shengyu Fu, Neel Sundaresan

25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19) | September 2020

Publication Project

IntelliCode Compose: Code Generation Using Transformer

Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, Neel Sundaresan

28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) | May 2020

Publication Video Project Project

InferFix: End-to-End Program Repair with LLMs over Retrieval-Augmented Prompts

Matthew Jin, Syed Shahriar, Michele Tufano, Xin Shi, Shuai Lu, Neel Sundaresan, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication Github

AdaptivePaste: Intelligent Copy-Paste in IDE

Xiaoyu Liu, Jinu Jang, Neel Sundaresan, Miltos Allamanis, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication

DeepDev-PERF: A Deep Learning-Based Approach for Improving Software Performance

Spandan Garg, Roshanak Zilouchian Moghaddam, Colin Clement, Neel Sundaresan, Chen Wu

ESEC/FSE | August 2022

Publication

Exploring and Evaluating Personalized Models for Code Generation

Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy, Colin Clement, Neel Sundaresan, Michele Tufano

Foundations of Software Engineering | August 2022

Publication Project

Generating Accurate Assert Statements for Unit Test Cases using Pretrained Transformers

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Neel Sundaresan

2022 IEEE/ACM International Conference on Automation of Software Test (AST) | May 2022

Publication Publication Publication Project

Methods2Test: A dataset of focal methods mapped to test cases

Michele Tufano, Shao Kun Deng, Neel Sundaresan, Alexey Svyatkovskiy

2022 International Conference on Mining Software Repositories (MSR) | May 2022

Publication Publication Project

Learning to Reduce False Positives in Analytic Bug Detectors

Anant Kharkar, Roshanak Zilouchian Moghaddam, Matthew Jin, Xiaoyu Liu, Xin Shi, Colin Clement, Neel Sundaresan

2022 International Conference on Software Engineering | May 2022

PDF

Generating Examples From CLI Usage: Can Transformers Help?

Roshanak Zilouchian Moghaddam, Spandan Garg, Colin Clement, Yevhen Mohylevskyy, Neel Sundaresan

KDD 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication Project Project

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Colin Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

2021 Empirical Methods in Natural Language Processing | October 2021

PDF Project Project

MergeBERT: Program Merge Conflict Resolution via Neural Transformers

Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri

August 2021

Publication Project Project

PerfLens: A Data-Driven Performance Bug Detection and Fix Platform

Spandan Garg, Roshanak Zilouchian Moghaddam, Neel Sundaresan, Chen Wu, Spandan Garg

SOAP ’21 | June 2021

Publication DOI

Unit Test Case Generation with Transformers and Focal Context

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, Neel Sundaresan

May 2021

PDF Project Project

DeepMerge: Learning to Merge Programs

Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri

May 2021

Publication Project

PyMT5: multi-mode translation of natural language and Python code with transformers

Colin Clement, Dawn Drain, Jonathan Timcheck, Alexey Svyatkovskiy, Neel Sundaresan

2020 Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication Publication Publication Project

GraphCodeBERT: Pre-training Code Representations with Data Flow

Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang (姜大昕), Ming Zhou

September 2020

PDF Publication Project Project

Pythia: AI-assisted Code Completion System

Alexey Svyatkovskiy, Ying Zhao, Shengyu Fu, Neel Sundaresan

25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19) | September 2020

Publication Project

IntelliCode Compose: Code Generation Using Transformer

Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, Neel Sundaresan

28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) | May 2020

Publication Video Project Project

DeepDev-PERF: A Deep Learning-Based Approach for Improving Software Performance

Spandan Garg, Roshanak Zilouchian Moghaddam, Colin Clement, Neel Sundaresan, Chen Wu

ESEC/FSE | August 2022

Publication

Learning to Reduce False Positives in Analytic Bug Detectors

Anant Kharkar, Roshanak Zilouchian Moghaddam, Matthew Jin, Xiaoyu Liu, Xin Shi, Colin Clement, Neel Sundaresan

2022 International Conference on Software Engineering | May 2022

PDF

Generating Examples From CLI Usage: Can Transformers Help?

Roshanak Zilouchian Moghaddam, Spandan Garg, Colin Clement, Yevhen Mohylevskyy, Neel Sundaresan

KDD 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication Project Project

Training and Evaluating a Jupyter Notebook Data Science Assistant

Shubham Chandel, Colin Clement, Guillermo Serrato, Neel Sundaresan

February 2022

Preprint

MergeBERT: Program Merge Conflict Resolution via Neural Transformers

Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri

August 2021

Publication Project Project

Distilling Transformers for Neural Cross-Domain Search

Colin Clement, Chen Wu, Dawn Drain, Neel Sundaresan

August 2021

Preprint

Unit Test Case Generation with Transformers and Focal Context

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, Neel Sundaresan

May 2021

PDF Project Project

Generating Bug-Fixes Using Pretrained Transformers

Dawn Drain, Chen Wu, Alexey Svyatkovskiy, Neel Sundaresan

PLDI 2021 | April 2021

Publication Project

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang (姜大昕), Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong (YIMING), Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu

February 2021

Publication Github Project Project Project

PyMT5: multi-mode translation of natural language and Python code with transformers

Colin Clement, Dawn Drain, Jonathan Timcheck, Alexey Svyatkovskiy, Neel Sundaresan

2020 Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication Publication Publication Project

Pythia: AI-assisted Code Completion System

Alexey Svyatkovskiy, Ying Zhao, Shengyu Fu, Neel Sundaresan

25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19) | September 2020

Publication Project

IntelliCode Compose: Code Generation Using Transformer

Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, Neel Sundaresan

28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) | May 2020

Publication Video Project Project

Exploring and Evaluating Personalized Models for Code Generation

Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy, Colin Clement, Neel Sundaresan, Michele Tufano

Foundations of Software Engineering | August 2022

Publication Project

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Colin Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

2021 Empirical Methods in Natural Language Processing | October 2021

PDF Project Project

Pythia: AI-assisted Code Completion System

Alexey Svyatkovskiy, Ying Zhao, Shengyu Fu, Neel Sundaresan

25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19) | September 2020

Publication Project

InferFix: End-to-End Program Repair with LLMs over Retrieval-Augmented Prompts

Matthew Jin, Syed Shahriar, Michele Tufano, Xin Shi, Shuai Lu, Neel Sundaresan, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication Github

AdaptivePaste: Intelligent Copy-Paste in IDE

Xiaoyu Liu, Jinu Jang, Neel Sundaresan, Miltos Allamanis, Alexey Svyatkovskiy

The ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’23) | December 2023

Publication

DeepDev-PERF: A Deep Learning-Based Approach for Improving Software Performance

Spandan Garg, Roshanak Zilouchian Moghaddam, Colin Clement, Neel Sundaresan, Chen Wu

ESEC/FSE | August 2022

Publication

Exploring and Evaluating Personalized Models for Code Generation

Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy, Colin Clement, Neel Sundaresan, Michele Tufano

Foundations of Software Engineering | August 2022

Publication Project

Generating Accurate Assert Statements for Unit Test Cases using Pretrained Transformers

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Neel Sundaresan

2022 IEEE/ACM International Conference on Automation of Software Test (AST) | May 2022

Publication Publication Publication Project

Methods2Test: A dataset of focal methods mapped to test cases

Michele Tufano, Shao Kun Deng, Neel Sundaresan, Alexey Svyatkovskiy

2022 International Conference on Mining Software Repositories (MSR) | May 2022

Publication Publication Project

Learning to Reduce False Positives in Analytic Bug Detectors

Anant Kharkar, Roshanak Zilouchian Moghaddam, Matthew Jin, Xiaoyu Liu, Xin Shi, Colin Clement, Neel Sundaresan

2022 International Conference on Software Engineering | May 2022

PDF

Generating Examples From CLI Usage: Can Transformers Help?

Roshanak Zilouchian Moghaddam, Spandan Garg, Colin Clement, Yevhen Mohylevskyy, Neel Sundaresan

KDD 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication Project Project

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Colin Clement, Shuai Lu, Xiaoyu Liu, Michele Tufano, Dawn Drain, Nan Duan, Neel Sundaresan, Alexey Svyatkovskiy

2021 Empirical Methods in Natural Language Processing | October 2021

PDF Project Project

PerfLens: A Data-Driven Performance Bug Detection and Fix Platform

Spandan Garg, Roshanak Zilouchian Moghaddam, Neel Sundaresan, Chen Wu, Spandan Garg

SOAP ’21 | June 2021

Publication DOI

Generating Bug-Fixes Using Pretrained Transformers

Dawn Drain, Chen Wu, Alexey Svyatkovskiy, Neel Sundaresan

PLDI 2021 | April 2021

Publication Project

PyMT5: multi-mode translation of natural language and Python code with transformers

Colin Clement, Dawn Drain, Jonathan Timcheck, Alexey Svyatkovskiy, Neel Sundaresan

2020 Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication Publication Publication Project

Pythia: AI-assisted Code Completion System

Alexey Svyatkovskiy, Ying Zhao, Shengyu Fu, Neel Sundaresan

25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD ’19) | September 2020

Publication Project

IntelliCode Compose: Code Generation Using Transformer

Alexey Svyatkovskiy, Shao Kun Deng, Shengyu Fu, Neel Sundaresan

28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) | May 2020

Publication Video Project Project

MergeBERT: Program Merge Conflict Resolution via Neural Transformers

Alexey Svyatkovskiy, Todd Mytkowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri

August 2021

Publication Project Project

Distilling Transformers for Neural Cross-Domain Search

Colin Clement, Chen Wu, Dawn Drain, Neel Sundaresan

August 2021

Preprint

DeepMerge: Learning to Merge Programs

Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, Shuvendu Lahiri

May 2021

Publication Project

Training and Evaluating a Jupyter Notebook Data Science Assistant

Shubham Chandel, Colin Clement, Guillermo Serrato, Neel Sundaresan

February 2022

Preprint

Unit Test Case Generation with Transformers and Focal Context

Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, Neel Sundaresan

May 2021

PDF Project Project

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang (姜大昕), Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong (YIMING), Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu

February 2021

Publication Github Project Project Project

GraphCodeBERT: Pre-training Code Representations with Data Flow

Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang (姜大昕), Ming Zhou

September 2020

PDF Publication Project Project