GEMS: Generative Expert Metric System through Iterative Prompt Priming
Ti-Chung Cheng, Carmen Badea, Christian Bird, Tom Zimmermann, Robert DeLine , Nicole Forsgren, Denae Ford
MSR-TR-2024-31 | August 2024
Published by Microsoft
Rob DeLine
Senior Principal Researcher
Publications
Publications by Year
-
-
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
Participatory prompting: a user-centric research method for eliciting AI assistance opportunities in knowledge workflows
Advait Sarkar, Ian Drosos, Robert DeLIne, Andy Gordon, Carina Negreanu, Sean Rintel, Jack Williams, Ben Zorn
Proceedings of the 34th Annual Conference of the Psychology of Programming Interest Group (PPIG 2023) | August 2023
-
What Did My AI Learn? How Data Scientists Make Sense of Model Behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert DeLIne, Adam Perer, Steven Drucker
ACM TOCHI | June 2022
Strategies for Reuse and Sharing among Data Scientists in Software Teams
Will Epperson, April Wang, Robert DeLIne, Steven Drucker
ICSE 2022 | May 2022
Diff in the Loop: Supporting Data Comparison in Exploratory Data Analysis
April Yi Wang, Will Epperson, Robert DeLIne, Steven Drucker
CHI 2022 | April 2022
-
Glinda: Supporting Data Science with Live Programming, GUIs and a Domain-specific Language
CHI Conference on Human Factors in Computing Systems | May 2021
-
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
-
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) - Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLIne, Steven Drucker
SIGCHI | May 2019
Managing Messes in Computational Notebooks
Andrew Head, Fred Hohman, Titus Barik, Steven Drucker, Robert DeLIne
SIGCHI | May 2019
Best Paper Award
-
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel M. German
IEEE Transactions on Software Engineering | December 2018, Vol 45(1): pp. 87-106
DOI PDF Publication Publication Publication Publication Publication
-
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel German
Transactions on Software Engineering | November 2017
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
-
Understanding the Breadth of the Event Space: Learning from Logan
Danyel Fisher, Steven Drucker, Mary Czerwinski, Robert DeLIne, Kael Rowan
Proceedings of the Event Event: Temporal & Sequential Event Analysis. IEEE VIS 2016 Workshop | October 2016
http://eventevent.github.io/
Making Sense of Temporal Queries with Interactive Visualization
Leilani Battle, Danyel Fisher, Robert DeLIne, Mike Barnett, Badrish Chandramouli, Jonathan Goldstein
Proceedings of the 34th Conference on Human-Computer Interaction (CHI 2016) | May 2016
The Bones of the System: A Study of Logging and Telemetry at Microsoft
Titus Barik, Robert DeLIne, Steven Drucker, Danyel Fisher
ICSE '16 Proceedings of the 38th International Conference on Software Engineering Companion | May 2016
Appendix to The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2016-4 | February 2016
-
Modern software is all about data. Development environments should be, too.
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanit | October 2015
ISBN: 978-1-4503-3722-9
The Future of Programming Languages and Programmers
Steven D. Fraser, Lars Bak, Robert DeLIne, Nick Feamster, Lindsey Kuper, Cristina V. Lopes, Peng Wu
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanity | October 2015
ISBN: 978-1-4503-3722-9
Supporting exploratory data analysis with live programming
Robert DeLIne, Danyel Fisher
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Tempe: Live Scripting For Live Data
Robert DeLIne, Danyel Fisher, Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, James Terwilliger, John Wernsing
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Trill: A High-Performance Incremental Query Processor for Diverse Analytics
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, Robert DeLine, Danyel Fisher, John Platt, James Terwilliger, John Wernsing, Robert DeLIne
August 2015
Research Opportunities for the Big Data Era of Software Engineering
Big Data Software Engineering (BIGDSE), 2015 IEEE/ACM 1st International Workshop on | May 2015
ISBN: 978-1-4673-7025-7
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
(s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences
Emanuel Zgraggen, Steven Drucker, Danyel Fisher, Robert DeLine, Robert DeLIne
April 2015
Proceedings of CHI 2015.
-
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
The Trill Incremental Analytics Engine
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, John Wernsing, John Platt, Robert DeLine, Danyel Fisher, James Terwilliger, Robert DeLIne
MSR-TR-2014-54 | April 2014
Get Me Here: Using Verification Tools to Answer Developer Questions
Mike Barnett, Robert DeLIne, Akash Lal, Shaz Qadeer
MSR-TR-2014-10 | February 2014
The Readability of Tweets and their Geographic Correlation with Education
James R. A. Davenport, Robert DeLIne
January 2014
-
Debugging Revisited, Toward Understanding the Debugging Needs of Contemporary Software Developers
Lucas Layman, Madeline Diep, Meiyappan Nagappan, Robert DeLIne, Gina Venolia
Empirical Software Engineering and Measurement, 2013 ACM / IEEE International Symposium on | October 2013
ISBN: 978-0-7695-5056-5
Stat! – An Interactive Analytics Environment for Big Data
Mike Barnett, Badrish Chandramouli, Robert DeLIne, Steven Drucker, Danyel Fisher, Jonathan Goldstein, Patrick Morrison, John Platt
ACM SIGMOD International Conference on Management of Data (SIGMOD 2013) | June 2013
-
Studying developers for fun and profit
Program Comprehension (ICPC), 2012 IEEE 20th International Conference on | June 2012
ISBN: 978-1-4673-1216-5
On Designing Better Tools for Learning APIs
Adrian Kuhn, Robert DeLIne
Search-Driven Development - Users, Infrastructure, Tools and Evaluation (SUITE), 2012 ICSE Workshop on | June 2012
ISBN: 978-1-4673-1848-8
Debugger Canvas: Industrial Experience with the Code Bubbles Paradigm
Andrew Bragdon, Kael Rowan, Jens Jacobsen, Robert DeLine, Robert DeLIne
International Conference on Software Engineering | June 2012
Interactions with Big Data Analytics
Danyel Fisher, Robert DeLIne, Mary Czerwinski, Steven Drucker
ACM Interactions | May 2012
This is a pre-publication draft; do not distribute or reproduce. The official version may be found at http://dl.acm.org/citation.cfm?doid=2168931.2168943
-
A field study of API learning obstacles
Martin P. Robillard, Robert DeLIne
Empirical Software Engineering | December 2011, Vol 16: pp. 703-732
Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings
Andrew Bragdon, Robert DeLIne, Ken Hinckley, Meredith Ringel Morris
ITS '11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces | November 2011
Lasting Impact Award (ISS 2020)
-
Code Talkers
Making Software: What Really Works, and Why We Believe It | Published by O'Reilly Media | 2010
Software Development with Code Maps
Robert DeLIne, Gina Venolia, Kael Rowan
Communications of the ACM | August 2010, Vol 53: pp. 48-54
Code Canvas: Zooming towards Better Development Environments
Proceedings of the International Conference on Software Engineering (New Ideas and Emerging Results) | May 2010
Evaluating Cues for Resuming Interrupted Programming Tasks
Robert DeLIne, Chris Parnin
CHI '10: Proceedings of the 28th international conference on Human factors in computing systems | April 2010
Honorable Mention Best Paper Award
-
Making CHASE Mainstream
Robert DeLine, Robert DeLIne
June 2009
CHASE Workshop - Keynote
Codebook: Social Networking over Code
Andrew Begel, Robert DeLIne
Proceedings of ICSE 09 (New Ideas and Emerging Results) | June 2009
Proceedings of ICSE 09 (New Ideas and Emerging Results)
Designers wanted: participation and the user experience in open source software development
Paula M. Bach, Robert DeLIne, John M. Carroll
Proceedings of CHI 09 | January 2009
-
Del.icio.us development tools
CHASE '08: Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering | May 2008
ISBN: 978-1-60558-039-5
-
Building an Ecologically valid, Large-scale Diagram to Help Developers Stay Oriented in Their Code
Mauro Cherubini, Gina Venolia, Robert DeLIne
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing | September 2007
ISBN: 0-7695-2987-9
Information Needs in Collocated Software Development Teams
Amy J. Ko, Robert DeLIne, Gina Venolia
ICSE '07: Proceedings of the 29th international conference on Software Engineering | May 2007
Let’s go to the whiteboard: how and why software developers use drawings
Mauro Cherubini, Gina Venolia, Robert DeLIne, Amy J. Ko
CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems | May 2007
-
Proceedings of Supporting the Social Side of Large-scale Software Development, a CSCW Workshop
Li-Te Cheng, Anthony Cox, Robert DeLIne, Cleidson de Souza, Kevin Schneider, Janice Singer, Margaret-Anne Storey, Gina Venolia
November 2006
Code Thumbnails: Using Spatial Memory to Navigate Source Code
Robert DeLIne, Mary Czerwinski, Brian Meyers, Gina Venolia, Steven Drucker, George Robertson
VLHCC '06: Proceedings of the Visual Languages and Human-Centric Computing | May 2006
ISBN: 0-7695-2586-5
Maintaining mental models: a study of developer work habits
Thomas D. LaToza, Gina Venolia, Robert DeLIne
ICSE '06: Proceedings of the 28th international conference on Software engineering | May 2006
ISBN: 1-59593-375-1
-
Boogie: A Modular Reusable Verifier for Object-Oriented Programs
Mike Barnett, Bor-Yuh Evan Chang, Robert DeLIne, Bart Jacobs, Rustan Leino
FMCO 2005 | November 2005
Software Development at Microsoft Observed
Gina Venolia, Robert DeLIne, Thomas LaToza
MSR-TR-2005-140 | October 2005
The Spec# Programming System: Challenges and Directions
Mike Barnett, Robert DeLIne, Manuel Fähndrich, Bart Jacobs, Rustan Leino, Wolfram Schulte, Herman Venter
VSTTE 2005: Verified Software: Theories, Tools, Experiments | September 2005
Easing Program Comprehension by Sharing Navigation Data
Robert DeLIne, Mary Czerwinski, George Robertson
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing | September 2005
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing
[best paper awared]
Towards Understanding Programs Through Wear-Based Filtering
Robert DeLIne, Amir Khella, Mary Czerwinski, George Robertson
SoftVis '05 Proceedings of the 2005 ACM symposium on Software visualization | May 2005
ISBN: 1-59593-073-6
BoogiePL: A Typed Procedural Language for Checking Object-Oriented Programs
Robert DeLIne, Rustan Leino
MSR-TR-2005-70 | March 2005
Staying Oriented with Software Terrain Maps
Workshop on Visual Languages and Computation | January 2005
-
Typestates for objects
Robert DeLIne, Manuel Fahndrich
ECOOP 2004 - Object-Oriented Programming | June 2004
ISBN: 978-3-540-24851-4
Verification of Object-Oriented Programs With Invariants
Mike Barnett, Robert DeLIne, Manuel Fahndrich, Rustan Leino, Wolfram Schulte
Journal of Object Technology, Special issue | June 2004, Vol 3(6): pp. 27-56
Published as Technical Report 408 from ETH Zurich.
Righting Software
Jim Larus, Thomas Ball, Manuvir Das , Robert DeLIne, Manuel Fahndrich, Jon Pincus, Sriram Rajamani, Ramanathan Venkatapathy
IEEE Software | May 2004, Vol 21: pp. 92-100
The Fugue Protocol Checker: Is Your Software Baroque?
Robert DeLIne, Manuel Fahndrich
MSR-TR-2004-07 | January 2004
-
Adoption and Focus: Practical Linear Types for Imperative Programming
Manuel Fahndrich, Robert DeLIne
Proceedings of the 2002 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2002
-
Corrections to ‘Avoiding Packaging Mismatch with Flexible Packaging’
IEEE Transactions on Software Engineering | June 2001, Vol 27: pp. 577
Enforcing high-level protocols in low-level software
Robert DeLIne, Manuel Fahndrich
Proceedings of the 2001 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2001
Avoiding packaging mismatch with Flexible Packaging
Robert DeLine, Robert DeLIne
IEEE Transactions on Software Engineering | February 2001, Vol 27: pp. 124-143
Avoiding packaging mismatch with Flexible Packaging
IEEE Transactions on Software Engineering | February 2001
-
A catalog of techniques for resolving packaging mismatch
Robert DeLine, Robert DeLIne
Proceedings of the Symposium on Software Reusability | January 1999
Resolving packaging mismatch
January 1999
PhD Thesis: Carnegie Mellon University | January 1999
-
Lessons on Converting Batch Systems to Support Interaction
Robert DeLIne, Gregory Zelesnik, Mary Shaw
ICSE '97 Proceedings of the 19th international conference on Software engineering | May 1997
ISBN: 0-89791-914-9
-
Abstractions and implementations for architectural connections
Mary Shaw, Robert DeLine, Gregory Zelesnik, Robert DeLIne
Third International Conference on Configurable Distributed Systems | January 1996
Third International Conference on Configurable Distributed Systems
Toward user-defined element types and architectural styles
ISAW '96 Joint proceedings of the second international software architecture workshop | January 1996
ISBN: 0-89791-867-3
-
Alice: Rapid prototyping system for virtual reality
Randy Pausch, Tommy Burnette, A.C. Capeheart, Matthew Conway, Dennis Cosgrove, Robert DeLIne, Jim Durbin, Rich Gossweiler, Shuichi Koga, Jeff White
IEEE Computer Graphics and Applications | May 1995, Vol 15: pp. 8-11
Abstractions for software architecture and tools to support them
Mary Shaw, Robert DeLine, Daniel Klein, Theodore Ross, David Young, Gregory Zelesnik, Robert DeLIne
IEEE Transactions on Software Engineering | April 1995, Vol 21(4): pp. 314-335
-
Developing calendar visualizers for the Information Visualizer
Jock D. Mackinlay, George Robertson, Robert DeLine, Robert DeLIne
Proceedings of the ACM Symposium on User Interface Software and Technology | January 1994
-
Alice and DIVER: A software architecture for building virtual environments
Randy Pausch, Matthew Conway, Robert DeLIne, Rich Gossweiler, Steve Miale
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems | April 1993
ISBN: 0-89791-574-7
-
Lessons learned from SUIT, the Simple User Interface Toolkit
Randy Pausch, Matthew Conway, Robert DeLIne
ACM Transactions on Office Information Systems | October 1992, Vol 10: pp. 320-344
SUIT: The simple user interface toolkit
Randy Pausch, Robert DeLIne, Matthew Conway
CHI '92 Posters and Short Talks of the 1992 SIGCHI Conference on Human Factors in Computing Systems | May 1992
-
SUIT: The Pascal of User Interface Toolkit
Randy Pausch, Nathaniel R. Young II, Robert DeLIne
UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology | November 1991
ISBN: 0-89791-451-1
Publications by Research Area
-
GEMS: Generative Expert Metric System through Iterative Prompt Priming
Ti-Chung Cheng, Carmen Badea, Christian Bird, Tom Zimmermann, Robert DeLine , Nicole Forsgren, Denae Ford
MSR-TR-2024-31 | August 2024
Published by Microsoft
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
Participatory prompting: a user-centric research method for eliciting AI assistance opportunities in knowledge workflows
Advait Sarkar, Ian Drosos, Robert DeLIne, Andy Gordon, Carina Negreanu, Sean Rintel, Jack Williams, Ben Zorn
Proceedings of the 34th Annual Conference of the Psychology of Programming Interest Group (PPIG 2023) | August 2023
What Did My AI Learn? How Data Scientists Make Sense of Model Behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert DeLIne, Adam Perer, Steven Drucker
ACM TOCHI | June 2022
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) - Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLIne, Steven Drucker
SIGCHI | May 2019
The Trill Incremental Analytics Engine
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, John Wernsing, John Platt, Robert DeLine, Danyel Fisher, James Terwilliger, Robert DeLIne
MSR-TR-2014-54 | April 2014
Stat! – An Interactive Analytics Environment for Big Data
Mike Barnett, Badrish Chandramouli, Robert DeLIne, Steven Drucker, Danyel Fisher, Jonathan Goldstein, Patrick Morrison, John Platt
ACM SIGMOD International Conference on Management of Data (SIGMOD 2013) | June 2013
-
Corrections to ‘Avoiding Packaging Mismatch with Flexible Packaging’
IEEE Transactions on Software Engineering | June 2001, Vol 27: pp. 577
Resolving packaging mismatch
January 1999
PhD Thesis: Carnegie Mellon University | January 1999
Lessons on Converting Batch Systems to Support Interaction
Robert DeLIne, Gregory Zelesnik, Mary Shaw
ICSE '97 Proceedings of the 19th international conference on Software engineering | May 1997
ISBN: 0-89791-914-9
Abstractions and implementations for architectural connections
Mary Shaw, Robert DeLine, Gregory Zelesnik, Robert DeLIne
Third International Conference on Configurable Distributed Systems | January 1996
Third International Conference on Configurable Distributed Systems
Toward user-defined element types and architectural styles
ISAW '96 Joint proceedings of the second international software architecture workshop | January 1996
ISBN: 0-89791-867-3
Alice: Rapid prototyping system for virtual reality
Randy Pausch, Tommy Burnette, A.C. Capeheart, Matthew Conway, Dennis Cosgrove, Robert DeLIne, Jim Durbin, Rich Gossweiler, Shuichi Koga, Jeff White
IEEE Computer Graphics and Applications | May 1995, Vol 15: pp. 8-11
Abstractions for software architecture and tools to support them
Mary Shaw, Robert DeLine, Daniel Klein, Theodore Ross, David Young, Gregory Zelesnik, Robert DeLIne
IEEE Transactions on Software Engineering | April 1995, Vol 21(4): pp. 314-335
Alice and DIVER: A software architecture for building virtual environments
Randy Pausch, Matthew Conway, Robert DeLIne, Rich Gossweiler, Steve Miale
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems | April 1993
ISBN: 0-89791-574-7
SUIT: The simple user interface toolkit
Randy Pausch, Robert DeLIne, Matthew Conway
CHI '92 Posters and Short Talks of the 1992 SIGCHI Conference on Human Factors in Computing Systems | May 1992
SUIT: The Pascal of User Interface Toolkit
Randy Pausch, Nathaniel R. Young II, Robert DeLIne
UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology | November 1991
ISBN: 0-89791-451-1
GEMS: Generative Expert Metric System through Iterative Prompt Priming
Ti-Chung Cheng, Carmen Badea, Christian Bird, Tom Zimmermann, Robert DeLine , Nicole Forsgren, Denae Ford
MSR-TR-2024-31 | August 2024
Published by Microsoft
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
Strategies for Reuse and Sharing among Data Scientists in Software Teams
Will Epperson, April Wang, Robert DeLIne, Steven Drucker
ICSE 2022 | May 2022
Glinda: Supporting Data Science with Live Programming, GUIs and a Domain-specific Language
CHI Conference on Human Factors in Computing Systems | May 2021
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) - Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
Managing Messes in Computational Notebooks
Andrew Head, Fred Hohman, Titus Barik, Steven Drucker, Robert DeLIne
SIGCHI | May 2019
Best Paper Award
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel German
Transactions on Software Engineering | November 2017
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The Bones of the System: A Study of Logging and Telemetry at Microsoft
Titus Barik, Robert DeLIne, Steven Drucker, Danyel Fisher
ICSE '16 Proceedings of the 38th International Conference on Software Engineering Companion | May 2016
Appendix to The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2016-4 | February 2016
The Future of Programming Languages and Programmers
Steven D. Fraser, Lars Bak, Robert DeLIne, Nick Feamster, Lindsey Kuper, Cristina V. Lopes, Peng Wu
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanity | October 2015
ISBN: 978-1-4503-3722-9
Modern software is all about data. Development environments should be, too.
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanit | October 2015
ISBN: 978-1-4503-3722-9
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
The Trill Incremental Analytics Engine
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, John Wernsing, John Platt, Robert DeLine, Danyel Fisher, James Terwilliger, Robert DeLIne
MSR-TR-2014-54 | April 2014
Get Me Here: Using Verification Tools to Answer Developer Questions
Mike Barnett, Robert DeLIne, Akash Lal, Shaz Qadeer
MSR-TR-2014-10 | February 2014
Debugging Revisited, Toward Understanding the Debugging Needs of Contemporary Software Developers
Lucas Layman, Madeline Diep, Meiyappan Nagappan, Robert DeLIne, Gina Venolia
Empirical Software Engineering and Measurement, 2013 ACM / IEEE International Symposium on | October 2013
ISBN: 978-0-7695-5056-5
Studying developers for fun and profit
Program Comprehension (ICPC), 2012 IEEE 20th International Conference on | June 2012
ISBN: 978-1-4673-1216-5
On Designing Better Tools for Learning APIs
Adrian Kuhn, Robert DeLIne
Search-Driven Development - Users, Infrastructure, Tools and Evaluation (SUITE), 2012 ICSE Workshop on | June 2012
ISBN: 978-1-4673-1848-8
Debugger Canvas: Industrial Experience with the Code Bubbles Paradigm
Andrew Bragdon, Kael Rowan, Jens Jacobsen, Robert DeLine, Robert DeLIne
International Conference on Software Engineering | June 2012
A field study of API learning obstacles
Martin P. Robillard, Robert DeLIne
Empirical Software Engineering | December 2011, Vol 16: pp. 703-732
Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings
Andrew Bragdon, Robert DeLIne, Ken Hinckley, Meredith Ringel Morris
ITS '11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces | November 2011
Lasting Impact Award (ISS 2020)
Code Talkers
Making Software: What Really Works, and Why We Believe It | Published by O'Reilly Media | 2010
Software Development with Code Maps
Robert DeLIne, Gina Venolia, Kael Rowan
Communications of the ACM | August 2010, Vol 53: pp. 48-54
Code Canvas: Zooming towards Better Development Environments
Proceedings of the International Conference on Software Engineering (New Ideas and Emerging Results) | May 2010
Evaluating Cues for Resuming Interrupted Programming Tasks
Robert DeLIne, Chris Parnin
CHI '10: Proceedings of the 28th international conference on Human factors in computing systems | April 2010
Honorable Mention Best Paper Award
Codebook: Social Networking over Code
Andrew Begel, Robert DeLIne
Proceedings of ICSE 09 (New Ideas and Emerging Results) | June 2009
Proceedings of ICSE 09 (New Ideas and Emerging Results)
Designers wanted: participation and the user experience in open source software development
Paula M. Bach, Robert DeLIne, John M. Carroll
Proceedings of CHI 09 | January 2009
Del.icio.us development tools
CHASE '08: Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering | May 2008
ISBN: 978-1-60558-039-5
Building an Ecologically valid, Large-scale Diagram to Help Developers Stay Oriented in Their Code
Mauro Cherubini, Gina Venolia, Robert DeLIne
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing | September 2007
ISBN: 0-7695-2987-9
Let’s go to the whiteboard: how and why software developers use drawings
Mauro Cherubini, Gina Venolia, Robert DeLIne, Amy J. Ko
CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems | May 2007
Information Needs in Collocated Software Development Teams
Amy J. Ko, Robert DeLIne, Gina Venolia
ICSE '07: Proceedings of the 29th international conference on Software Engineering | May 2007
Proceedings of Supporting the Social Side of Large-scale Software Development, a CSCW Workshop
Li-Te Cheng, Anthony Cox, Robert DeLIne, Cleidson de Souza, Kevin Schneider, Janice Singer, Margaret-Anne Storey, Gina Venolia
November 2006
Code Thumbnails: Using Spatial Memory to Navigate Source Code
Robert DeLIne, Mary Czerwinski, Brian Meyers, Gina Venolia, Steven Drucker, George Robertson
VLHCC '06: Proceedings of the Visual Languages and Human-Centric Computing | May 2006
ISBN: 0-7695-2586-5
Maintaining mental models: a study of developer work habits
Thomas D. LaToza, Gina Venolia, Robert DeLIne
ICSE '06: Proceedings of the 28th international conference on Software engineering | May 2006
ISBN: 1-59593-375-1
Software Development at Microsoft Observed
Gina Venolia, Robert DeLIne, Thomas LaToza
MSR-TR-2005-140 | October 2005
The Spec# Programming System: Challenges and Directions
Mike Barnett, Robert DeLIne, Manuel Fähndrich, Bart Jacobs, Rustan Leino, Wolfram Schulte, Herman Venter
VSTTE 2005: Verified Software: Theories, Tools, Experiments | September 2005
Easing Program Comprehension by Sharing Navigation Data
Robert DeLIne, Mary Czerwinski, George Robertson
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing | September 2005
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing
[best paper awared]
Towards Understanding Programs Through Wear-Based Filtering
Robert DeLIne, Amir Khella, Mary Czerwinski, George Robertson
SoftVis '05 Proceedings of the 2005 ACM symposium on Software visualization | May 2005
ISBN: 1-59593-073-6
BoogiePL: A Typed Procedural Language for Checking Object-Oriented Programs
Robert DeLIne, Rustan Leino
MSR-TR-2005-70 | March 2005
Staying Oriented with Software Terrain Maps
Workshop on Visual Languages and Computation | January 2005
Typestates for objects
Robert DeLIne, Manuel Fahndrich
ECOOP 2004 - Object-Oriented Programming | June 2004
ISBN: 978-3-540-24851-4
Verification of Object-Oriented Programs With Invariants
Mike Barnett, Robert DeLIne, Manuel Fahndrich, Rustan Leino, Wolfram Schulte
Journal of Object Technology, Special issue | June 2004, Vol 3(6): pp. 27-56
Published as Technical Report 408 from ETH Zurich.
Righting Software
Jim Larus, Thomas Ball, Manuvir Das , Robert DeLIne, Manuel Fahndrich, Jon Pincus, Sriram Rajamani, Ramanathan Venkatapathy
IEEE Software | May 2004, Vol 21: pp. 92-100
The Fugue Protocol Checker: Is Your Software Baroque?
Robert DeLIne, Manuel Fahndrich
MSR-TR-2004-07 | January 2004
Adoption and Focus: Practical Linear Types for Imperative Programming
Manuel Fahndrich, Robert DeLIne
Proceedings of the 2002 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2002
-
Participatory prompting: a user-centric research method for eliciting AI assistance opportunities in knowledge workflows
Advait Sarkar, Ian Drosos, Robert DeLIne, Andy Gordon, Carina Negreanu, Sean Rintel, Jack Williams, Ben Zorn
Proceedings of the 34th Annual Conference of the Psychology of Programming Interest Group (PPIG 2023) | August 2023
-
Participatory prompting: a user-centric research method for eliciting AI assistance opportunities in knowledge workflows
Advait Sarkar, Ian Drosos, Robert DeLIne, Andy Gordon, Carina Negreanu, Sean Rintel, Jack Williams, Ben Zorn
Proceedings of the 34th Annual Conference of the Psychology of Programming Interest Group (PPIG 2023) | August 2023
What Did My AI Learn? How Data Scientists Make Sense of Model Behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert DeLIne, Adam Perer, Steven Drucker
ACM TOCHI | June 2022
Diff in the Loop: Supporting Data Comparison in Exploratory Data Analysis
April Yi Wang, Will Epperson, Robert DeLIne, Steven Drucker
CHI 2022 | April 2022
Glinda: Supporting Data Science with Live Programming, GUIs and a Domain-specific Language
CHI Conference on Human Factors in Computing Systems | May 2021
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLIne, Steven Drucker
SIGCHI | May 2019
Managing Messes in Computational Notebooks
Andrew Head, Fred Hohman, Titus Barik, Steven Drucker, Robert DeLIne
SIGCHI | May 2019
Best Paper Award
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel M. German
IEEE Transactions on Software Engineering | December 2018, Vol 45(1): pp. 87-106
DOI PDF Publication Publication Publication Publication Publication
Understanding the Breadth of the Event Space: Learning from Logan
Danyel Fisher, Steven Drucker, Mary Czerwinski, Robert DeLIne, Kael Rowan
Proceedings of the Event Event: Temporal & Sequential Event Analysis. IEEE VIS 2016 Workshop | October 2016
http://eventevent.github.io/
Making Sense of Temporal Queries with Interactive Visualization
Leilani Battle, Danyel Fisher, Robert DeLIne, Mike Barnett, Badrish Chandramouli, Jonathan Goldstein
Proceedings of the 34th Conference on Human-Computer Interaction (CHI 2016) | May 2016
(s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences
Emanuel Zgraggen, Steven Drucker, Danyel Fisher, Robert DeLine, Robert DeLIne
April 2015
Proceedings of CHI 2015.
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
Stat! – An Interactive Analytics Environment for Big Data
Mike Barnett, Badrish Chandramouli, Robert DeLIne, Steven Drucker, Danyel Fisher, Jonathan Goldstein, Patrick Morrison, John Platt
ACM SIGMOD International Conference on Management of Data (SIGMOD 2013) | June 2013
Interactions with Big Data Analytics
Danyel Fisher, Robert DeLIne, Mary Czerwinski, Steven Drucker
ACM Interactions | May 2012
This is a pre-publication draft; do not distribute or reproduce. The official version may be found at http://dl.acm.org/citation.cfm?doid=2168931.2168943
Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings
Andrew Bragdon, Robert DeLIne, Ken Hinckley, Meredith Ringel Morris
ITS '11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces | November 2011
Lasting Impact Award (ISS 2020)
Code Canvas: Zooming towards Better Development Environments
Proceedings of the International Conference on Software Engineering (New Ideas and Emerging Results) | May 2010
Building an Ecologically valid, Large-scale Diagram to Help Developers Stay Oriented in Their Code
Mauro Cherubini, Gina Venolia, Robert DeLIne
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing | September 2007
ISBN: 0-7695-2987-9
Let’s go to the whiteboard: how and why software developers use drawings
Mauro Cherubini, Gina Venolia, Robert DeLIne, Amy J. Ko
CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems | May 2007
Proceedings of Supporting the Social Side of Large-scale Software Development, a CSCW Workshop
Li-Te Cheng, Anthony Cox, Robert DeLIne, Cleidson de Souza, Kevin Schneider, Janice Singer, Margaret-Anne Storey, Gina Venolia
November 2006
Code Thumbnails: Using Spatial Memory to Navigate Source Code
Robert DeLIne, Mary Czerwinski, Brian Meyers, Gina Venolia, Steven Drucker, George Robertson
VLHCC '06: Proceedings of the Visual Languages and Human-Centric Computing | May 2006
ISBN: 0-7695-2586-5
Maintaining mental models: a study of developer work habits
Thomas D. LaToza, Gina Venolia, Robert DeLIne
ICSE '06: Proceedings of the 28th international conference on Software engineering | May 2006
ISBN: 1-59593-375-1
Easing Program Comprehension by Sharing Navigation Data
Robert DeLIne, Mary Czerwinski, George Robertson
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing | September 2005
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing
[best paper awared]
Staying Oriented with Software Terrain Maps
Workshop on Visual Languages and Computation | January 2005
-
What Did My AI Learn? How Data Scientists Make Sense of Model Behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert DeLIne, Adam Perer, Steven Drucker
ACM TOCHI | June 2022
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLIne, Steven Drucker
SIGCHI | May 2019
Managing Messes in Computational Notebooks
Andrew Head, Fred Hohman, Titus Barik, Steven Drucker, Robert DeLIne
SIGCHI | May 2019
Best Paper Award
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
Understanding the Breadth of the Event Space: Learning from Logan
Danyel Fisher, Steven Drucker, Mary Czerwinski, Robert DeLIne, Kael Rowan
Proceedings of the Event Event: Temporal & Sequential Event Analysis. IEEE VIS 2016 Workshop | October 2016
http://eventevent.github.io/
Making Sense of Temporal Queries with Interactive Visualization
Leilani Battle, Danyel Fisher, Robert DeLIne, Mike Barnett, Badrish Chandramouli, Jonathan Goldstein
Proceedings of the 34th Conference on Human-Computer Interaction (CHI 2016) | May 2016
Supporting exploratory data analysis with live programming
Robert DeLIne, Danyel Fisher
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Tempe: Live Scripting For Live Data
Robert DeLIne, Danyel Fisher, Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, James Terwilliger, John Wernsing
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Trill: A High-Performance Incremental Query Processor for Diverse Analytics
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, Robert DeLine, Danyel Fisher, John Platt, James Terwilliger, John Wernsing, Robert DeLIne
August 2015
Research Opportunities for the Big Data Era of Software Engineering
Big Data Software Engineering (BIGDSE), 2015 IEEE/ACM 1st International Workshop on | May 2015
ISBN: 978-1-4673-7025-7
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
(s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences
Emanuel Zgraggen, Steven Drucker, Danyel Fisher, Robert DeLine, Robert DeLIne
April 2015
Proceedings of CHI 2015.
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
The Trill Incremental Analytics Engine
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, John Wernsing, John Platt, Robert DeLine, Danyel Fisher, James Terwilliger, Robert DeLIne
MSR-TR-2014-54 | April 2014
-
The Readability of Tweets and their Geographic Correlation with Education
James R. A. Davenport, Robert DeLIne
January 2014
Building an Ecologically valid, Large-scale Diagram to Help Developers Stay Oriented in Their Code
Mauro Cherubini, Gina Venolia, Robert DeLIne
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing | September 2007
ISBN: 0-7695-2987-9
Let’s go to the whiteboard: how and why software developers use drawings
Mauro Cherubini, Gina Venolia, Robert DeLIne, Amy J. Ko
CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems | May 2007
Information Needs in Collocated Software Development Teams
Amy J. Ko, Robert DeLIne, Gina Venolia
ICSE '07: Proceedings of the 29th international conference on Software Engineering | May 2007
Proceedings of Supporting the Social Side of Large-scale Software Development, a CSCW Workshop
Li-Te Cheng, Anthony Cox, Robert DeLIne, Cleidson de Souza, Kevin Schneider, Janice Singer, Margaret-Anne Storey, Gina Venolia
November 2006
Maintaining mental models: a study of developer work habits
Thomas D. LaToza, Gina Venolia, Robert DeLIne
ICSE '06: Proceedings of the 28th international conference on Software engineering | May 2006
ISBN: 1-59593-375-1
-
Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings
Andrew Bragdon, Robert DeLIne, Ken Hinckley, Meredith Ringel Morris
ITS '11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces | November 2011
Lasting Impact Award (ISS 2020)
-
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
Interactions with Big Data Analytics
Danyel Fisher, Robert DeLIne, Mary Czerwinski, Steven Drucker
ACM Interactions | May 2012
This is a pre-publication draft; do not distribute or reproduce. The official version may be found at http://dl.acm.org/citation.cfm?doid=2168931.2168943
-
Making CHASE Mainstream
Robert DeLine, Robert DeLIne
June 2009
CHASE Workshop - Keynote
-
Boogie: A Modular Reusable Verifier for Object-Oriented Programs
Mike Barnett, Bor-Yuh Evan Chang, Robert DeLIne, Bart Jacobs, Rustan Leino
FMCO 2005 | November 2005
-
Typestates for objects
Robert DeLIne, Manuel Fahndrich
ECOOP 2004 - Object-Oriented Programming | June 2004
ISBN: 978-3-540-24851-4
-
Enforcing high-level protocols in low-level software
Robert DeLIne, Manuel Fahndrich
Proceedings of the 2001 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2001
Avoiding packaging mismatch with Flexible Packaging
Robert DeLine, Robert DeLIne
IEEE Transactions on Software Engineering | February 2001, Vol 27: pp. 124-143
Avoiding packaging mismatch with Flexible Packaging
IEEE Transactions on Software Engineering | February 2001
A catalog of techniques for resolving packaging mismatch
Robert DeLine, Robert DeLIne
Proceedings of the Symposium on Software Reusability | January 1999
Developing calendar visualizers for the Information Visualizer
Jock D. Mackinlay, George Robertson, Robert DeLine, Robert DeLIne
Proceedings of the ACM Symposium on User Interface Software and Technology | January 1994
Lessons learned from SUIT, the Simple User Interface Toolkit
Randy Pausch, Matthew Conway, Robert DeLIne
ACM Transactions on Office Information Systems | October 1992, Vol 10: pp. 320-344
-
Alice: Rapid prototyping system for virtual reality
Randy Pausch, Tommy Burnette, A.C. Capeheart, Matthew Conway, Dennis Cosgrove, Robert DeLIne, Jim Durbin, Rich Gossweiler, Shuichi Koga, Jeff White
IEEE Computer Graphics and Applications | May 1995, Vol 15: pp. 8-11
Publications by Type
-
GEMS: Generative Expert Metric System through Iterative Prompt Priming
Ti-Chung Cheng, Carmen Badea, Christian Bird, Tom Zimmermann, Robert DeLine , Nicole Forsgren, Denae Ford
MSR-TR-2024-31 | August 2024
Published by Microsoft
Appendix to The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2016-4 | February 2016
The Emerging Role of Data Scientists on Software Development Teams
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
MSR-TR-2015-30 | April 2015
Tempe: An Interactive Data Science Environment for Exploration of Temporal and Streaming Data
Danyel Fisher, Badrish Chandramouli, Robert DeLIne, Jonathan Goldstein, Andrei Aron, Mike Barnett, John Platt, James Terwilliger, John Wernsing
MSR-TR-2014-148 | November 2014
The Trill Incremental Analytics Engine
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, John Wernsing, John Platt, Robert DeLine, Danyel Fisher, James Terwilliger, Robert DeLIne
MSR-TR-2014-54 | April 2014
Get Me Here: Using Verification Tools to Answer Developer Questions
Mike Barnett, Robert DeLIne, Akash Lal, Shaz Qadeer
MSR-TR-2014-10 | February 2014
Software Development at Microsoft Observed
Gina Venolia, Robert DeLIne, Thomas LaToza
MSR-TR-2005-140 | October 2005
BoogiePL: A Typed Procedural Language for Checking Object-Oriented Programs
Robert DeLIne, Rustan Leino
MSR-TR-2005-70 | March 2005
The Fugue Protocol Checker: Is Your Software Baroque?
Robert DeLIne, Manuel Fahndrich
MSR-TR-2004-07 | January 2004
-
Corrections to ‘Avoiding Packaging Mismatch with Flexible Packaging’
IEEE Transactions on Software Engineering | June 2001, Vol 27: pp. 577
Avoiding packaging mismatch with Flexible Packaging
Robert DeLine, Robert DeLIne
IEEE Transactions on Software Engineering | February 2001, Vol 27: pp. 124-143
Alice: Rapid prototyping system for virtual reality
Randy Pausch, Tommy Burnette, A.C. Capeheart, Matthew Conway, Dennis Cosgrove, Robert DeLIne, Jim Durbin, Rich Gossweiler, Shuichi Koga, Jeff White
IEEE Computer Graphics and Applications | May 1995, Vol 15: pp. 8-11
Abstractions for software architecture and tools to support them
Mary Shaw, Robert DeLine, Daniel Klein, Theodore Ross, David Young, Gregory Zelesnik, Robert DeLIne
IEEE Transactions on Software Engineering | April 1995, Vol 21(4): pp. 314-335
Lessons learned from SUIT, the Simple User Interface Toolkit
Randy Pausch, Matthew Conway, Robert DeLIne
ACM Transactions on Office Information Systems | October 1992, Vol 10: pp. 320-344
Can GPT-4 Replicate Empirical Software Engineering Research?
Jenny Liang, Carmen Badea, Christian Bird, Robert DeLine, Denae Ford, Nicole Forsgren, Tom Zimmermann
October 2023
What Did My AI Learn? How Data Scientists Make Sense of Model Behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert DeLIne, Adam Perer, Steven Drucker
ACM TOCHI | June 2022
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel M. German
IEEE Transactions on Software Engineering | December 2018, Vol 45(1): pp. 87-106
DOI PDF Publication Publication Publication Publication Publication
What Makes a Great Manager of Software Engineers?
Eirini Kalliamvakou, Christian Bird, Tom Zimmermann, Andrew Begel, Robert DeLIne, Daniel German
Transactions on Software Engineering | November 2017
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Tom Zimmermann, Robert DeLIne, Andrew Begel
IEEE Transactions on Software Engineering | September 2017
The Readability of Tweets and their Geographic Correlation with Education
James R. A. Davenport, Robert DeLIne
January 2014
Interactions with Big Data Analytics
Danyel Fisher, Robert DeLIne, Mary Czerwinski, Steven Drucker
ACM Interactions | May 2012
This is a pre-publication draft; do not distribute or reproduce. The official version may be found at http://dl.acm.org/citation.cfm?doid=2168931.2168943
A field study of API learning obstacles
Martin P. Robillard, Robert DeLIne
Empirical Software Engineering | December 2011, Vol 16: pp. 703-732
Software Development with Code Maps
Robert DeLIne, Gina Venolia, Kael Rowan
Communications of the ACM | August 2010, Vol 53: pp. 48-54
Verification of Object-Oriented Programs With Invariants
Mike Barnett, Robert DeLIne, Manuel Fahndrich, Rustan Leino, Wolfram Schulte
Journal of Object Technology, Special issue | June 2004, Vol 3(6): pp. 27-56
Published as Technical Report 408 from ETH Zurich.
Righting Software
Jim Larus, Thomas Ball, Manuvir Das , Robert DeLIne, Manuel Fahndrich, Jon Pincus, Sriram Rajamani, Ramanathan Venkatapathy
IEEE Software | May 2004, Vol 21: pp. 92-100
-
Enforcing high-level protocols in low-level software
Robert DeLIne, Manuel Fahndrich
Proceedings of the 2001 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2001
Avoiding packaging mismatch with Flexible Packaging
IEEE Transactions on Software Engineering | February 2001
A catalog of techniques for resolving packaging mismatch
Robert DeLine, Robert DeLIne
Proceedings of the Symposium on Software Reusability | January 1999
Lessons on Converting Batch Systems to Support Interaction
Robert DeLIne, Gregory Zelesnik, Mary Shaw
ICSE '97 Proceedings of the 19th international conference on Software engineering | May 1997
ISBN: 0-89791-914-9
Abstractions and implementations for architectural connections
Mary Shaw, Robert DeLine, Gregory Zelesnik, Robert DeLIne
Third International Conference on Configurable Distributed Systems | January 1996
Third International Conference on Configurable Distributed Systems
Toward user-defined element types and architectural styles
ISAW '96 Joint proceedings of the second international software architecture workshop | January 1996
ISBN: 0-89791-867-3
Developing calendar visualizers for the Information Visualizer
Jock D. Mackinlay, George Robertson, Robert DeLine, Robert DeLIne
Proceedings of the ACM Symposium on User Interface Software and Technology | January 1994
Alice and DIVER: A software architecture for building virtual environments
Randy Pausch, Matthew Conway, Robert DeLIne, Rich Gossweiler, Steve Miale
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems | April 1993
ISBN: 0-89791-574-7
SUIT: The simple user interface toolkit
Randy Pausch, Robert DeLIne, Matthew Conway
CHI '92 Posters and Short Talks of the 1992 SIGCHI Conference on Human Factors in Computing Systems | May 1992
SUIT: The Pascal of User Interface Toolkit
Randy Pausch, Nathaniel R. Young II, Robert DeLIne
UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology | November 1991
ISBN: 0-89791-451-1
Participatory prompting: a user-centric research method for eliciting AI assistance opportunities in knowledge workflows
Advait Sarkar, Ian Drosos, Robert DeLIne, Andy Gordon, Carina Negreanu, Sean Rintel, Jack Williams, Ben Zorn
Proceedings of the 34th Annual Conference of the Psychology of Programming Interest Group (PPIG 2023) | August 2023
Strategies for Reuse and Sharing among Data Scientists in Software Teams
Will Epperson, April Wang, Robert DeLIne, Steven Drucker
ICSE 2022 | May 2022
Diff in the Loop: Supporting Data Comparison in Exploratory Data Analysis
April Yi Wang, Will Epperson, Robert DeLIne, Steven Drucker
CHI 2022 | April 2022
Glinda: Supporting Data Science with Live Programming, GUIs and a Domain-specific Language
CHI Conference on Human Factors in Computing Systems | May 2021
Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists
Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLIne, Sumit Gulwani
ACM CHI Conference on Human Factors in Computing Systems | April 2020
Best Paper Award
Software Engineering for Machine Learning: A Case Study
Saleema Amershi, Andrew Begel, Christian Bird, Robert DeLIne, Harald Gall, Ece Kamar, Nachi Nagappan, Besmira Nushi, Tom Zimmermann
International Conference on Software Engineering (ICSE 2019) - Software Engineering in Practice track | May 2019
ICSE 2019 Best Paper Award
Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
Fred Hohman, Andrew Head, Rich Caruana, Robert DeLIne, Steven Drucker
SIGCHI | May 2019
Managing Messes in Computational Notebooks
Andrew Head, Fred Hohman, Titus Barik, Steven Drucker, Robert DeLIne
SIGCHI | May 2019
Best Paper Award
Understanding the Breadth of the Event Space: Learning from Logan
Danyel Fisher, Steven Drucker, Mary Czerwinski, Robert DeLIne, Kael Rowan
Proceedings of the Event Event: Temporal & Sequential Event Analysis. IEEE VIS 2016 Workshop | October 2016
http://eventevent.github.io/
Making Sense of Temporal Queries with Interactive Visualization
Leilani Battle, Danyel Fisher, Robert DeLIne, Mike Barnett, Badrish Chandramouli, Jonathan Goldstein
Proceedings of the 34th Conference on Human-Computer Interaction (CHI 2016) | May 2016
The Bones of the System: A Study of Logging and Telemetry at Microsoft
Titus Barik, Robert DeLIne, Steven Drucker, Danyel Fisher
ICSE '16 Proceedings of the 38th International Conference on Software Engineering Companion | May 2016
The Future of Programming Languages and Programmers
Steven D. Fraser, Lars Bak, Robert DeLIne, Nick Feamster, Lindsey Kuper, Cristina V. Lopes, Peng Wu
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanity | October 2015
ISBN: 978-1-4503-3722-9
Modern software is all about data. Development environments should be, too.
SPLASH Companion 2015 Companion Proceedings of the 2015 ACM SIGPLAN International Conference on Systems, Programming, Languages and Applications: Software for Humanit | October 2015
ISBN: 978-1-4503-3722-9
Supporting exploratory data analysis with live programming
Robert DeLIne, Danyel Fisher
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Tempe: Live Scripting For Live Data
Robert DeLIne, Danyel Fisher, Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, James Terwilliger, John Wernsing
Visual Languages and Human-Centric Computing (VL/HCC), 2015 IEEE Symposium on | October 2015
ISBN: 978-1-4673-7457-6
Trill: A High-Performance Incremental Query Processor for Diverse Analytics
Badrish Chandramouli, Jonathan Goldstein, Mike Barnett, Robert DeLine, Danyel Fisher, John Platt, James Terwilliger, John Wernsing, Robert DeLIne
August 2015
Research Opportunities for the Big Data Era of Software Engineering
Big Data Software Engineering (BIGDSE), 2015 IEEE/ACM 1st International Workshop on | May 2015
ISBN: 978-1-4673-7025-7
(s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences
Emanuel Zgraggen, Steven Drucker, Danyel Fisher, Robert DeLine, Robert DeLIne
April 2015
Proceedings of CHI 2015.
Debugging Revisited, Toward Understanding the Debugging Needs of Contemporary Software Developers
Lucas Layman, Madeline Diep, Meiyappan Nagappan, Robert DeLIne, Gina Venolia
Empirical Software Engineering and Measurement, 2013 ACM / IEEE International Symposium on | October 2013
ISBN: 978-0-7695-5056-5
Stat! – An Interactive Analytics Environment for Big Data
Mike Barnett, Badrish Chandramouli, Robert DeLIne, Steven Drucker, Danyel Fisher, Jonathan Goldstein, Patrick Morrison, John Platt
ACM SIGMOD International Conference on Management of Data (SIGMOD 2013) | June 2013
Studying developers for fun and profit
Program Comprehension (ICPC), 2012 IEEE 20th International Conference on | June 2012
ISBN: 978-1-4673-1216-5
On Designing Better Tools for Learning APIs
Adrian Kuhn, Robert DeLIne
Search-Driven Development - Users, Infrastructure, Tools and Evaluation (SUITE), 2012 ICSE Workshop on | June 2012
ISBN: 978-1-4673-1848-8
Debugger Canvas: Industrial Experience with the Code Bubbles Paradigm
Andrew Bragdon, Kael Rowan, Jens Jacobsen, Robert DeLine, Robert DeLIne
International Conference on Software Engineering | June 2012
Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings
Andrew Bragdon, Robert DeLIne, Ken Hinckley, Meredith Ringel Morris
ITS '11 Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces | November 2011
Lasting Impact Award (ISS 2020)
Code Canvas: Zooming towards Better Development Environments
Proceedings of the International Conference on Software Engineering (New Ideas and Emerging Results) | May 2010
Evaluating Cues for Resuming Interrupted Programming Tasks
Robert DeLIne, Chris Parnin
CHI '10: Proceedings of the 28th international conference on Human factors in computing systems | April 2010
Honorable Mention Best Paper Award
Codebook: Social Networking over Code
Andrew Begel, Robert DeLIne
Proceedings of ICSE 09 (New Ideas and Emerging Results) | June 2009
Proceedings of ICSE 09 (New Ideas and Emerging Results)
Designers wanted: participation and the user experience in open source software development
Paula M. Bach, Robert DeLIne, John M. Carroll
Proceedings of CHI 09 | January 2009
Del.icio.us development tools
CHASE '08: Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering | May 2008
ISBN: 978-1-60558-039-5
Building an Ecologically valid, Large-scale Diagram to Help Developers Stay Oriented in Their Code
Mauro Cherubini, Gina Venolia, Robert DeLIne
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing | September 2007
ISBN: 0-7695-2987-9
Let’s go to the whiteboard: how and why software developers use drawings
Mauro Cherubini, Gina Venolia, Robert DeLIne, Amy J. Ko
CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems | May 2007
Information Needs in Collocated Software Development Teams
Amy J. Ko, Robert DeLIne, Gina Venolia
ICSE '07: Proceedings of the 29th international conference on Software Engineering | May 2007
Proceedings of Supporting the Social Side of Large-scale Software Development, a CSCW Workshop
Li-Te Cheng, Anthony Cox, Robert DeLIne, Cleidson de Souza, Kevin Schneider, Janice Singer, Margaret-Anne Storey, Gina Venolia
November 2006
Code Thumbnails: Using Spatial Memory to Navigate Source Code
Robert DeLIne, Mary Czerwinski, Brian Meyers, Gina Venolia, Steven Drucker, George Robertson
VLHCC '06: Proceedings of the Visual Languages and Human-Centric Computing | May 2006
ISBN: 0-7695-2586-5
Maintaining mental models: a study of developer work habits
Thomas D. LaToza, Gina Venolia, Robert DeLIne
ICSE '06: Proceedings of the 28th international conference on Software engineering | May 2006
ISBN: 1-59593-375-1
Boogie: A Modular Reusable Verifier for Object-Oriented Programs
Mike Barnett, Bor-Yuh Evan Chang, Robert DeLIne, Bart Jacobs, Rustan Leino
FMCO 2005 | November 2005
The Spec# Programming System: Challenges and Directions
Mike Barnett, Robert DeLIne, Manuel Fähndrich, Bart Jacobs, Rustan Leino, Wolfram Schulte, Herman Venter
VSTTE 2005: Verified Software: Theories, Tools, Experiments | September 2005
Easing Program Comprehension by Sharing Navigation Data
Robert DeLIne, Mary Czerwinski, George Robertson
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing | September 2005
Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing
[best paper awared]
Towards Understanding Programs Through Wear-Based Filtering
Robert DeLIne, Amir Khella, Mary Czerwinski, George Robertson
SoftVis '05 Proceedings of the 2005 ACM symposium on Software visualization | May 2005
ISBN: 1-59593-073-6
Staying Oriented with Software Terrain Maps
Workshop on Visual Languages and Computation | January 2005
Typestates for objects
Robert DeLIne, Manuel Fahndrich
ECOOP 2004 - Object-Oriented Programming | June 2004
ISBN: 978-3-540-24851-4
Adoption and Focus: Practical Linear Types for Imperative Programming
Manuel Fahndrich, Robert DeLIne
Proceedings of the 2002 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) | May 2002
-
Code Talkers
Making Software: What Really Works, and Why We Believe It | Published by O'Reilly Media | 2010
-
Making CHASE Mainstream
Robert DeLine, Robert DeLIne
June 2009
CHASE Workshop - Keynote
-
Resolving packaging mismatch
January 1999
PhD Thesis: Carnegie Mellon University | January 1999