LM Agents for Coordinating Multi-User Information Gathering
Harsh Jhamtani, Jacob Andreas, Ben Van Durme
February 2025
Ben Van Durme
Principal Researcher
Publications
Publications by Year
-
-
From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
ICLR 2025 | December 2024
Language-to-Code Translation with a Single Labeled Example
Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
EMNLP | November 2024
Ontologically Faithful Generation of Non-Player Character Dialogues
Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
EMNLP | November 2024
Learning to Retrieve Iteratively for In-Context Learning
Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
EMNLP | November 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
Multi-Field Adaptive Retrieval
Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
ICLR 2025 | October 2024
Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
ICLR 2025 | October 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
ICLR 2025 | September 2024
Natural Language Decomposition and Interpretation of Complex Utterances
Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
IJCAI 2024 | August 2024
Interpreting User Requests in the Context of Natural Language Standing Instructions
Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
NAACL | June 2024
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
arXiv: Computation and Language | March 2024
-
Do Androids Know They’re Only Dreaming of Electric Sheep?
Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
arXiv: Computation and Language | December 2023
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
SCREWS: A Modular Framework for Reasoning with Revisions
Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
arXiv: Computation and Language | September 2023
-
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
EMNLP 2022 | December 2022
Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
Association of Computational Linguistics | July 2022
Few-Shot Semantic Parsing with Language Models Trained on Code
Richard Shin, Ben Van Durme
NAACL 2022 | July 2022
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
ACL 2022 | May 2022
-
Constrained Language Models Yield Few-Shot Semantic Parsers
Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
EMNLP 2021 | November 2021
Publications by Research Area
-
LM Agents for Coordinating Multi-User Information Gathering
Harsh Jhamtani, Jacob Andreas, Ben Van Durme
February 2025
From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
ICLR 2025 | December 2024
Language-to-Code Translation with a Single Labeled Example
Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
EMNLP | November 2024
Learning to Retrieve Iteratively for In-Context Learning
Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
EMNLP | November 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
Multi-Field Adaptive Retrieval
Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
ICLR 2025 | October 2024
Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
ICLR 2025 | October 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
ICLR 2025 | September 2024
Natural Language Decomposition and Interpretation of Complex Utterances
Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
IJCAI 2024 | August 2024
Interpreting User Requests in the Context of Natural Language Standing Instructions
Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
NAACL | June 2024
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
arXiv: Computation and Language | March 2024
Do Androids Know They’re Only Dreaming of Electric Sheep?
Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
arXiv: Computation and Language | December 2023
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
SCREWS: A Modular Framework for Reasoning with Revisions
Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
arXiv: Computation and Language | September 2023
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
EMNLP 2022 | December 2022
Few-Shot Semantic Parsing with Language Models Trained on Code
Richard Shin, Ben Van Durme
NAACL 2022 | July 2022
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
ACL 2022 | May 2022
-
LM Agents for Coordinating Multi-User Information Gathering
Harsh Jhamtani, Jacob Andreas, Ben Van Durme
February 2025
Language-to-Code Translation with a Single Labeled Example
Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
EMNLP | November 2024
Ontologically Faithful Generation of Non-Player Character Dialogues
Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
EMNLP | November 2024
Learning to Retrieve Iteratively for In-Context Learning
Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
EMNLP | November 2024
Natural Language Decomposition and Interpretation of Complex Utterances
Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
IJCAI 2024 | August 2024
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
SCREWS: A Modular Framework for Reasoning with Revisions
Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
arXiv: Computation and Language | September 2023
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
EMNLP 2022 | December 2022
Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
Association of Computational Linguistics | July 2022
Few-Shot Semantic Parsing with Language Models Trained on Code
Richard Shin, Ben Van Durme
NAACL 2022 | July 2022
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
ACL 2022 | May 2022
Constrained Language Models Yield Few-Shot Semantic Parsers
Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
EMNLP 2021 | November 2021
-
Multi-Field Adaptive Retrieval
Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
ICLR 2025 | October 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
ICLR 2025 | September 2024
Publications by Type
-
LM Agents for Coordinating Multi-User Information Gathering
Harsh Jhamtani, Jacob Andreas, Ben Van Durme
February 2025
-
From Models to Microtheories: Distilling a Model’s Topical Knowledge for Grounded Question Answering
Nathaniel Weir, Bhavana Dalvi, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, P. Jansen, Ben Van Durme, Peter Clark
ICLR 2025 | December 2024
Language-to-Code Translation with a Single Labeled Example
Kaj Bostrom, Harsh Jhamtani, Hao Fang, Sam Thomson, Richard Shin, Patrick Xia, Ben Van Durme, Jason Eisner, Jacob Andreas
EMNLP | November 2024
Ontologically Faithful Generation of Non-Player Character Dialogues
Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Ben Van Durme, Harsh Jhamtani
EMNLP | November 2024
Learning to Retrieve Iteratively for In-Context Learning
Yunmo Chen, Tongfei Chen, Harsh Jhamtani, Patrick Xia, Richard Shin, Jason Eisner, Ben Van Durme
EMNLP | November 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
Multi-Field Adaptive Retrieval
Millicent Li, Tongfei Chen, Ben Van Durme, Patrick Xia
ICLR 2025 | October 2024
Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
Jingyu (Jack) Zhang, Ahmed Elgohary, Ahmed Magooda, Daniel Khashabi, Ben Van Durme
ICLR 2025 | October 2024
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Orion Weller, Ben Van Durme, Dawn Lawrie, Ashwin Paranjape, Yuhao Zhang, Jack Hessel
ICLR 2025 | September 2024
Natural Language Decomposition and Interpretation of Complex Utterances
Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme
IJCAI 2024 | August 2024
Interpreting User Requests in the Context of Natural Language Standing Instructions
Nikita Moghe, Patrick Xia, Jacob Andreas, Jason Eisner, Ben Van Durme, Harsh Jhamtani
NAACL | June 2024
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
Elias Stengel-Eskin, Emmanouil Antonios Platanios, Adam Pauls, Sam Thomson, Hao Fang, Ben Van Durme, Jason Eisner, Yu Su
EMNLP 2022 | December 2022
Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code
Ryan Volum, Sudha Rao, Michael Xu, Gabriel DesGarennes, Chris Brockett, Ben Van Durme, Olivia Deng, Akanksha Malhotra, Bill Dolan
Association of Computational Linguistics | July 2022
Few-Shot Semantic Parsing with Language Models Trained on Code
Richard Shin, Ben Van Durme
NAACL 2022 | July 2022
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation
Kevin Yang, Olivia Deng, Charles Chen, Richard Shin, Subhro Roy, Ben Van Durme
ACL 2022 | May 2022
Constrained Language Models Yield Few-Shot Semantic Parsers
Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Ben Van Durme
EMNLP 2021 | November 2021
-
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
Boshi Wang, Hao Fang, Jason Eisner, Ben Van Durme, Yu Su
arXiv: Computation and Language | March 2024
Do Androids Know They’re Only Dreaming of Electric Sheep?
Sky CH-Wang, Ben Van Durme, Jason Eisner, Chris Kedzie
arXiv: Computation and Language | December 2023
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing
Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Ben Van Durme
NeurIPS 2023 Track on Datasets and Benchmarks. | December 2023
SCREWS: A Modular Framework for Reasoning with Revisions
Kumar Shridhar, Harsh Jhamtani, Hao Fang, Ben Van Durme, Jason Eisner, Patrick Xia
arXiv: Computation and Language | September 2023