DreamGarden: A Designer Assistant for Growing Games from a Single Prompt
Sam Earle, Samyak Parajuli, Andrzej Banburski-Fahey
CHI 2025 | April 2025
Publications
Publications by Year
-
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
On the Emergence of Thinking in LLMs I: Searching for the Right Intuition
Guanghao Ye, Khiem Duc Pham, Xinzhi Zhang, Sivakanth Gopi, Baolin Peng, Beibin Li, Janardhan (Jana) Kulkarni, Huseyin Inan
February 2025
-
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
-
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
-
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Label Noise in Adversarial Training: A Novel Perspective to Study Robust Overfitting
Chengyu Dong, Liyuan Liu, Jingbo Shang
NeurIPS 2022 (Oral) | November 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
INK: Intensive Neural Knowledge
James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao
MSR-TR-2022-38 | July 2022
Published by Microsoft MSR-TR-2022-38
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
LAFITE: Towards Language-Free Training for Text-to-Image Generation
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
CVPR 2022 | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
-
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers
Chia-Hsuan Lee, Alex Polozov, Matthew Richardson
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci … Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
-
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Improved Image Wasserstein Attacks and Defenses
Edward J. Hu, Adith Swaminathan, Hadi Salman, Greg Yang
2020 International Conference on Learning Representations | July 2020
Best paper award at ICLR Trustworthy ML Workshop 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”
Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, Kazuhito Koishida
Thirty-seventh International Conference on Machine Learning (ICML) | July 2020
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson
ACL 2020 | June 2020
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
-
Program Synthesis and Semantic Parsing with Learned Code Idioms
Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov
NeurIPS 2019 | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach
Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon
Interspeech | September 2019
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Efficient Adaptation of Pretrained Transformers for Abstractive Summarization
Andrew Hoang, Antoine Bosselut, Asli Celikyilmaz, Yejin Choi
June 2019
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Attentive Tensor Product Learning
Qiuyuan Huang, Li Deng, Oliver Wu, Chang Liu, Xiaodong He
AAAI 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
NAIL: A General Interactive Fiction Agent
Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason Williams
arXiv: Machine Learning | February 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
-
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
Nudging Neural Conversational Model with Domain Knowledge
Sungjin Lee
November 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Deep Communicating Agents for Abstractive Summarization
Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Natural Language to Structured Query Generation via Meta-Learning
Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, Xiaodong He
NAACL HLT 2018 | June 2018
Tensor Product Generation Networks for Deep NLP Modeling
Qiuyuan Huang, Paul Smolensky, Xiaodong He, Oliver Wu, Li Deng
NAACL 2018 | June 2018
long paper
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He
May 2018
arxiv
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
Towards Neural Phrase-based Machine Translation
Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng
ICLR 2018 Conference | April 2018
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
-
Adversarial Ranking for Language Generation
Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun
NIPS 2017 | December 2017
Deep Learning for Spoken and Text Dialog Systems
Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur
Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017
Deep Learning in Conversational Language Understanding
Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng
Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Deep Learning for Dialogue Systems
Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tur
Proceedings of ACL 2017 | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension
David Golub, Po-Sen Huang, Xiaodong He, Li Deng
EMNLP 2017 | September 2017
Learning Generic Sentence Representations Using Convolutional Neural Networks
Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin
EMNLP 2017 | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Provably Optimal Algorithms for Generalized Linear Contextual Bandits
Lihong Li, Yu Lu, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Sequence Modeling via Segmentations
Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Denny Zhou, Li Deng
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Stochastic Variance Reduction Methods for Policy Evaluation
Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization
Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
Neural Phrase-Based Machine Translation
Po-Sen Huang, Chong Wang, Denny Zhou, Li Deng
June 2017
arXiv preprint
Neuro-Symbolic Program Synthesis
Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli
The 5th International Conference on Learning Representations (ICLR) | April 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Scaffolding Networks for Teaching and Learning to Comprehend
Asli Celikyilmaz, Li Deng, Lihong Li, Chong Wang
February 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
-
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Frustratingly Easy Neural Domain Adaptation
Young-Bum Kim, Karl Stratos, Ruhi Sarikaya
COLING | December 2016
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Character-Level Question Answering with Attention
David Golub, Xiaodong He
EMNLP 2016 | November 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Intent Detection using Semantically Enriched Word Embeddings
Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang
IEEE SLT 2016 | September 2016
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Generating Natural Questions About an Image
Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
Click-based Hot Fixes for Underperforming Torso Queries
Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Multi-Rate Deep Learning for Temporal Recommendation
Yang Song, Ali Elkahky, Xiaodong He
SIGIR 2016 | July 2016
Rich Image Captioning in the Wild
Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz
DeepVision workshop, Proceedings of CVPR 2016 | June 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Online Evaluation for Information Retrieval
Katja Hofmann, Lihong Li, Filip Radlinski
Foundations and Trends® in Information Retrieval | June 2016, Vol 10: pp. 1-117
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Hierarchical Attention Networks for Document Classification
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy
NAACL 2016 | June 2016
Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Website: www.sind.ai
An Efficient Algorithm for Contextual Bandits with Knapsacks, and an Extension to Concave Objectives
Shipra Agrawal, Nikhil Devanur, Lihong Li
Proceedings of the 29th Conference on Learning Theory (COLT) – JMLR: Workshop and Conference Proceedings | June 2016
Doubly Robust Off-policy Evaluation for Reinforcement Learning
Nan Jiang, Lihong Li
JMLR: Workshop and Conference Proceedings; Proceedings of the 33rd International Conference on Machine Learning (ICML) | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
Table Cell Search for Question Answering
Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan
Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016
Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)
Xiaodong He
MSR-TR-2016-16 | April 2016
Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
IEEE ICASSP | March 2016
Exploring Multiple Feature Spaces for Novel Entity Discovery
Zhaohui Wu, Yang Song, C. Lee Giles
AAAI 2016 | February 2016
AAAI 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
-
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Learning Bidirectional Intent Embeddings by Convolutional Deep Structured Semantic Models for Spoken Language Understanding
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
NIPS workshop | December 2015
Evaluation of Deep Learning Frameworks
Kenneth Tran
November 2015
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
July 2015
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Ali Mamdouh Elkahky, Yang Song, Xiaodong He
WWW 2015 | May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
-
Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data
Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik
December 2014
Deep Learning and Continuous Representations for Language Processing (Tutorial for SLT-2014)
Xiaodong He, Scott Wen-tau Yih
December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Semantic Parsing for Single-Relation Question Answering
Scott Wen-tau Yih, Xiaodong He, Chris Meek
Proceedings of ACL | June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Adapting Deep RankNet for Personalized Search
Yang Song, Hongning Wang, Xiaodong He
WSDM 2014 | February 2014
-
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding
Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio
Interspeech 2013 | August 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
-
Use of Kernel Deep Convex Networks and End-To-End Learning for Spoken Language Understanding
Li Deng, Gokhan Tur, Xiaodong He, Dilek Hakkani-Tür
December 2012
Towards Deeper Understanding Deep Convex Networks for Semantic Utterance Classification
Gokhan Tur, Li Deng, Dilek Hakkani-Tür, Xiaodong He
March 2012
Symbolic Functions From Neural Computation
Philosophical Transactions of the Royal Society A | January 2012, Vol 370: pp. 3543-3569
-
Optimality: From Neural Networks to Universal Grammar
Alan Prince, Paul Smolensky
Science | March 1997, Vol 275: pp. 1604-1610
-
Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems
Artificial Intelligence | January 1990, Vol 46: pp. 159-216
Publications by Research Area
-
Optimality: From Neural Networks to Universal Grammar
Alan Prince, Paul Smolensky
Science | March 1997, Vol 275: pp. 1604-1610
Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems
Artificial Intelligence | January 1990, Vol 46: pp. 159-216
DreamGarden: A Designer Assistant for Growing Games from a Single Prompt
Sam Earle, Samyak Parajuli, Andrzej Banburski-Fahey
CHI 2025 | April 2025
On the Emergence of Thinking in LLMs I: Searching for the Right Intuition
Guanghao Ye, Khiem Duc Pham, Xinzhi Zhang, Sivakanth Gopi, Baolin Peng, Beibin Li, Janardhan (Jana) Kulkarni, Huseyin Inan
February 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Label Noise in Adversarial Training: A Novel Perspective to Study Robust Overfitting
Chengyu Dong, Liyuan Liu, Jingbo Shang
NeurIPS 2022 (Oral) | November 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
INK: Intensive Neural Knowledge
James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao
MSR-TR-2022-38 | July 2022
Published by Microsoft MSR-TR-2022-38
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
LAFITE: Towards Language-Free Training for Text-to-Image Generation
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
CVPR 2022 | June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers
Chia-Hsuan Lee, Alex Polozov, Matthew Richardson
ACL-IJCNLP 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci … Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”
Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, Kazuhito Koishida
Thirty-seventh International Conference on Machine Learning (ICML) | July 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
Improved Image Wasserstein Attacks and Defenses
Edward J. Hu, Adith Swaminathan, Hadi Salman, Greg Yang
2020 International Conference on Learning Representations | July 2020
Best paper award at ICLR Trustworthy ML Workshop 2020
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson
ACL 2020 | June 2020
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Program Synthesis and Semantic Parsing with Learned Code Idioms
Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov
NeurIPS 2019 | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach
Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon
Interspeech | September 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Efficient Adaptation of Pretrained Transformers for Abstractive Summarization
Andrew Hoang, Antoine Bosselut, Asli Celikyilmaz, Yejin Choi
June 2019
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Attentive Tensor Product Learning
Qiuyuan Huang, Li Deng, Oliver Wu, Chang Liu, Xiaodong He
AAAI 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
NAIL: A General Interactive Fiction Agent
Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason Williams
arXiv: Machine Learning | February 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Deep Communicating Agents for Abstractive Summarization
Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Tensor Product Generation Networks for Deep NLP Modeling
Qiuyuan Huang, Paul Smolensky, Xiaodong He, Oliver Wu, Li Deng
NAACL 2018 | June 2018
long paper
Natural Language to Structured Query Generation via Meta-Learning
Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, Xiaodong He
NAACL HLT 2018 | June 2018
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He
May 2018
arxiv
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
Towards Neural Phrase-based Machine Translation
Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng
ICLR 2018 Conference | April 2018
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
Adversarial Ranking for Language Generation
Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun
NIPS 2017 | December 2017
Deep Learning in Conversational Language Understanding
Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng
Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017
Deep Learning for Spoken and Text Dialog Systems
Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur
Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Deep Learning for Dialogue Systems
Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tur
Proceedings of ACL 2017 | November 2017
Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension
David Golub, Po-Sen Huang, Xiaodong He, Li Deng
EMNLP 2017 | September 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Provably Optimal Algorithms for Generalized Linear Contextual Bandits
Lihong Li, Yu Lu, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Stochastic Variance Reduction Methods for Policy Evaluation
Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Sequence Modeling via Segmentations
Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Denny Zhou, Li Deng
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization
Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
Neural Phrase-Based Machine Translation
Po-Sen Huang, Chong Wang, Denny Zhou, Li Deng
June 2017
arXiv preprint
Neuro-Symbolic Program Synthesis
Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli
The 5th International Conference on Learning Representations (ICLR) | April 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Scaffolding Networks for Teaching and Learning to Comprehend
Asli Celikyilmaz, Li Deng, Lihong Li, Chong Wang
February 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Frustratingly Easy Neural Domain Adaptation
Young-Bum Kim, Karl Stratos, Ruhi Sarikaya
COLING | December 2016
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Character-Level Question Answering with Attention
David Golub, Xiaodong He
EMNLP 2016 | November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Intent Detection using Semantically Enriched Word Embeddings
Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang
IEEE SLT 2016 | September 2016
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Generating Natural Questions About an Image
Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
Click-based Hot Fixes for Underperforming Torso Queries
Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Multi-Rate Deep Learning for Temporal Recommendation
Yang Song, Ali Elkahky, Xiaodong He
SIGIR 2016 | July 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Rich Image Captioning in the Wild
Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz
DeepVision workshop, Proceedings of CVPR 2016 | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Hierarchical Attention Networks for Document Classification
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy
NAACL 2016 | June 2016
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Website: www.sind.ai
Doubly Robust Off-policy Evaluation for Reinforcement Learning
Nan Jiang, Lihong Li
JMLR: Workshop and Conference Proceedings; Proceedings of the 33rd International Conference on Machine Learning (ICML) | June 2016
An Efficient Algorithm for Contextual Bandits with Knapsacks, and an Extension to Concave Objectives
Shipra Agrawal, Nikhil Devanur, Lihong Li
Proceedings of the 29th Conference on Learning Theory (COLT) – JMLR: Workshop and Conference Proceedings | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
Table Cell Search for Question Answering
Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan
Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016
Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)
Xiaodong He
MSR-TR-2016-16 | April 2016
Exploring Multiple Feature Spaces for Novel Entity Discovery
Zhaohui Wu, Yang Song, C. Lee Giles
AAAI 2016 | February 2016
AAAI 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Learning Bidirectional Intent Embeddings by Convolutional Deep Structured Semantic Models for Spoken Language Understanding
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
NIPS workshop | December 2015
Evaluation of Deep Learning Frameworks
Kenneth Tran
November 2015
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Ali Mamdouh Elkahky, Yang Song, Xiaodong He
WWW 2015 | May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data
Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik
December 2014
Deep Learning and Continuous Representations for Language Processing (Tutorial for SLT-2014)
Xiaodong He, Scott Wen-tau Yih
December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Semantic Parsing for Single-Relation Question Answering
Scott Wen-tau Yih, Xiaodong He, Chris Meek
Proceedings of ACL | June 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Adapting Deep RankNet for Personalized Search
Yang Song, Hongning Wang, Xiaodong He
WSDM 2014 | February 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding
Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio
Interspeech 2013 | August 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
Use of Kernel Deep Convex Networks and End-To-End Learning for Spoken Language Understanding
Li Deng, Gokhan Tur, Xiaodong He, Dilek Hakkani-Tür
December 2012
Symbolic Functions From Neural Computation
Philosophical Transactions of the Royal Society A | January 2012, Vol 370: pp. 3543-3569
-
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
INK: Intensive Neural Knowledge
James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao
MSR-TR-2022-38 | July 2022
Published by Microsoft MSR-TR-2022-38
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson
ACL 2020 | June 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach
Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon
Interspeech | September 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Nudging Neural Conversational Model with Domain Knowledge
Sungjin Lee
November 2018
Deep Communicating Agents for Abstractive Summarization
Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Towards Neural Phrase-based Machine Translation
Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng
ICLR 2018 Conference | April 2018
Adversarial Ranking for Language Generation
Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun
NIPS 2017 | December 2017
Deep Learning in Conversational Language Understanding
Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng
Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017
Deep Learning for Spoken and Text Dialog Systems
Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur
Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension
David Golub, Po-Sen Huang, Xiaodong He, Li Deng
EMNLP 2017 | September 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Learning Generic Sentence Representations Using Convolutional Neural Networks
Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin
EMNLP 2017 | September 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Frustratingly Easy Neural Domain Adaptation
Young-Bum Kim, Karl Stratos, Ruhi Sarikaya
COLING | December 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Character-Level Question Answering with Attention
David Golub, Xiaodong He
EMNLP 2016 | November 2016
Intent Detection using Semantically Enriched Word Embeddings
Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang
IEEE SLT 2016 | September 2016
Generating Natural Questions About an Image
Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
Rich Image Captioning in the Wild
Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz
DeepVision workshop, Proceedings of CVPR 2016 | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Hierarchical Attention Networks for Document Classification
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy
NAACL 2016 | June 2016
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Website: www.sind.ai
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
Table Cell Search for Question Answering
Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan
Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016
Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)
Xiaodong He
MSR-TR-2016-16 | April 2016
Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
IEEE ICASSP | March 2016
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
July 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Semantic Parsing for Single-Relation Question Answering
Scott Wen-tau Yih, Xiaodong He, Chris Meek
Proceedings of ACL | June 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
-
DreamGarden: A Designer Assistant for Growing Games from a Single Prompt
Sam Earle, Samyak Parajuli, Andrzej Banburski-Fahey
CHI 2025 | April 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach
Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon
Interspeech | September 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Nudging Neural Conversational Model with Domain Knowledge
Sungjin Lee
November 2018
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
-
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
LAFITE: Towards Language-Free Training for Text-to-Image Generation
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
CVPR 2022 | June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He
May 2018
arxiv
Deep Learning with Low Precision by Half-wave Gaussian Quantization
Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Rich Image Captioning in the Wild
Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz
DeepVision workshop, Proceedings of CVPR 2016 | June 2016
Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Website: www.sind.ai
Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)
Xiaodong He
MSR-TR-2016-16 | April 2016
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
July 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
-
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
-
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
-
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Click-based Hot Fixes for Underperforming Torso Queries
Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Online Evaluation for Information Retrieval
Katja Hofmann, Lihong Li, Filip Radlinski
Foundations and Trends® in Information Retrieval | June 2016, Vol 10: pp. 1-117
Exploring Multiple Feature Spaces for Novel Entity Discovery
Zhaohui Wu, Yang Song, C. Lee Giles
AAAI 2016 | February 2016
AAAI 2016
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Ali Mamdouh Elkahky, Yang Song, Xiaodong He
WWW 2015 | May 2015
Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data
Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik
December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Adapting Deep RankNet for Personalized Search
Yang Song, Hongning Wang, Xiaodong He
WSDM 2014 | February 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding
Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio
Interspeech 2013 | August 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Towards Deeper Understanding Deep Convex Networks for Semantic Utterance Classification
Gokhan Tur, Li Deng, Dilek Hakkani-Tür, Xiaodong He
March 2012
-
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
Program Synthesis and Semantic Parsing with Learned Code Idioms
Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov
NeurIPS 2019 | December 2019
Neuro-Symbolic Program Synthesis
Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli
The 5th International Conference on Learning Representations (ICLR) | April 2017
-
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers
Chia-Hsuan Lee, Alex Polozov, Matthew Richardson
ACL-IJCNLP 2021 | August 2021
Click-based Hot Fixes for Underperforming Torso Queries
Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
-
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Stochastic Variance Reduction Methods for Policy Evaluation
Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
-
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Publications by Type
-
On the Emergence of Thinking in LLMs I: Searching for the Right Intuition
Guanghao Ye, Khiem Duc Pham, Xinzhi Zhang, Sivakanth Gopi, Baolin Peng, Beibin Li, Janardhan (Jana) Kulkarni, Huseyin Inan
February 2025
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
Efficient Adaptation of Pretrained Transformers for Abstractive Summarization
Andrew Hoang, Antoine Bosselut, Asli Celikyilmaz, Yejin Choi
June 2019
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
Neural Phrase-Based Machine Translation
Po-Sen Huang, Chong Wang, Denny Zhou, Li Deng
June 2017
arXiv preprint
-
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
Nudging Neural Conversational Model with Domain Knowledge
Sungjin Lee
November 2018
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He
May 2018
arxiv
Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)
Xiaodong He
June 2015
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
Deep Learning and Continuous Representations for Language Processing (Tutorial for SLT-2014)
Xiaodong He, Scott Wen-tau Yih
December 2014
-
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
INK: Intensive Neural Knowledge
James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao
MSR-TR-2022-38 | July 2022
Published by Microsoft MSR-TR-2022-38
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)
Xiaodong He
MSR-TR-2016-16 | April 2016
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
-
DreamGarden: A Designer Assistant for Growing Games from a Single Prompt
Sam Earle, Samyak Parajuli, Andrzej Banburski-Fahey
CHI 2025 | April 2025
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Label Noise in Adversarial Training: A Novel Perspective to Study Robust Overfitting
Chengyu Dong, Liyuan Liu, Jingbo Shang
NeurIPS 2022 (Oral) | November 2022
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
LAFITE: Towards Language-Free Training for Text-to-Image Generation
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun
CVPR 2022 | June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers
Chia-Hsuan Lee, Alex Polozov, Matthew Richardson
ACL-IJCNLP 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”
Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, Kazuhito Koishida
Thirty-seventh International Conference on Machine Learning (ICML) | July 2020
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
Improved Image Wasserstein Attacks and Defenses
Edward J. Hu, Adith Swaminathan, Hadi Salman, Greg Yang
2020 International Conference on Learning Representations | July 2020
Best paper award at ICLR Trustworthy ML Workshop 2020
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson
ACL 2020 | June 2020
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Program Synthesis and Semantic Parsing with Learned Code Idioms
Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov
NeurIPS 2019 | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach
Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon
Interspeech | September 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Attentive Tensor Product Learning
Qiuyuan Huang, Li Deng, Oliver Wu, Chang Liu, Xiaodong He
AAAI 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Deep Communicating Agents for Abstractive Summarization
Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018
Tensor Product Generation Networks for Deep NLP Modeling
Qiuyuan Huang, Paul Smolensky, Xiaodong He, Oliver Wu, Li Deng
NAACL 2018 | June 2018
long paper
Natural Language to Structured Query Generation via Meta-Learning
Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, Xiaodong He
NAACL HLT 2018 | June 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
Towards Neural Phrase-based Machine Translation
Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng
ICLR 2018 Conference | April 2018
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
Adversarial Ranking for Language Generation
Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun
NIPS 2017 | December 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Deep Learning for Dialogue Systems
Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tur
Proceedings of ACL 2017 | November 2017
Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension
David Golub, Po-Sen Huang, Xiaodong He, Li Deng
EMNLP 2017 | September 2017
Learning Generic Sentence Representations Using Convolutional Neural Networks
Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin
EMNLP 2017 | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Provably Optimal Algorithms for Generalized Linear Contextual Bandits
Lihong Li, Yu Lu, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Stochastic Variance Reduction Methods for Policy Evaluation
Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Sequence Modeling via Segmentations
Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Denny Zhou, Li Deng
Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization
Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
Neuro-Symbolic Program Synthesis
Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli
The 5th International Conference on Learning Representations (ICLR) | April 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
Frustratingly Easy Neural Domain Adaptation
Young-Bum Kim, Karl Stratos, Ruhi Sarikaya
COLING | December 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Character-Level Question Answering with Attention
David Golub, Xiaodong He
EMNLP 2016 | November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Intent Detection using Semantically Enriched Word Embeddings
Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang
IEEE SLT 2016 | September 2016
Generating Natural Questions About an Image
Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
Click-based Hot Fixes for Underperforming Torso Queries
Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016
Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Multi-Rate Deep Learning for Temporal Recommendation
Yang Song, Ali Elkahky, Xiaodong He
SIGIR 2016 | July 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Rich Image Captioning in the Wild
Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz
DeepVision workshop, Proceedings of CVPR 2016 | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Hierarchical Attention Networks for Document Classification
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy
NAACL 2016 | June 2016
A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016
Website: www.sind.ai
Doubly Robust Off-policy Evaluation for Reinforcement Learning
Nan Jiang, Lihong Li
JMLR: Workshop and Conference Proceedings; Proceedings of the 33rd International Conference on Machine Learning (ICML) | June 2016
An Efficient Algorithm for Contextual Bandits with Knapsacks, and an Extension to Concave Objectives
Shipra Agrawal, Nikhil Devanur, Lihong Li
Proceedings of the 29th Conference on Learning Theory (COLT) – JMLR: Workshop and Conference Proceedings | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
Table Cell Search for Question Answering
Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan
Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016
Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
IEEE ICASSP | March 2016
Exploring Multiple Feature Spaces for Novel Entity Discovery
Zhaohui Wu, Yang Song, C. Lee Giles
AAAI 2016 | February 2016
AAAI 2016
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Learning Bidirectional Intent Embeddings by Convolutional Deep Structured Semantic Models for Spoken Language Understanding
Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He
NIPS workshop | December 2015
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
July 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems
Ali Mamdouh Elkahky, Yang Song, Xiaodong He
WWW 2015 | May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data
Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik
December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Semantic Parsing for Single-Relation Question Answering
Scott Wen-tau Yih, Xiaodong He, Chris Meek
Proceedings of ACL | June 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Adapting Deep RankNet for Personalized Search
Yang Song, Hongning Wang, Xiaodong He
WSDM 2014 | February 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding
Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio
Interspeech 2013 | August 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
Use of Kernel Deep Convex Networks and End-To-End Learning for Spoken Language Understanding
Li Deng, Gokhan Tur, Xiaodong He, Dilek Hakkani-Tür
December 2012
Towards Deeper Understanding Deep Convex Networks for Semantic Utterance Classification
Gokhan Tur, Li Deng, Dilek Hakkani-Tür, Xiaodong He
March 2012
-
Optimality: From Neural Networks to Universal Grammar
Alan Prince, Paul Smolensky
Science | March 1997, Vol 275: pp. 1604-1610
Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems
Artificial Intelligence | January 1990, Vol 46: pp. 159-216
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci … Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
NAIL: A General Interactive Fiction Agent
Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason Williams
arXiv: Machine Learning | February 2019
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
Scaffolding Networks for Teaching and Learning to Comprehend
Asli Celikyilmaz, Li Deng, Lihong Li, Chong Wang
February 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Online Evaluation for Information Retrieval
Katja Hofmann, Lihong Li, Filip Radlinski
Foundations and Trends® in Information Retrieval | June 2016, Vol 10: pp. 1-117
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Evaluation of Deep Learning Frameworks
Kenneth Tran
November 2015
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015
Symbolic Functions From Neural Computation
Philosophical Transactions of the Royal Society A | January 2012, Vol 370: pp. 3543-3569
-
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
-
Deep Learning in Conversational Language Understanding
Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng
Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017
Deep Learning for Spoken and Text Dialog Systems
Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur
Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017