Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
CHI 2025 | April 2025
Jianfeng Gao
Distinguished Scientist & Vice President
Publications
Publications by Year
-
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
ICLR 2025 | April 2025
Magma: A Foundation Model for Multimodal AI Agents
Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
February 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
-
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
NeurIPS 2024 | December 2024
SCBench: A KV Cache-Centric Analysis of Long-Context Methods
Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
ICLR 2025 | December 2024
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Smolensky, Jianfeng Gao, Roland Fernandez
2024 Neural Information Processing Systems | December 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
2024 Neural Information Processing Systems | October 2024
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
June 2024
Crafting Interpretable Embeddings by Asking LLMs Questions
Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
NeurIPS 2024 | May 2024
A whole-slide foundation model for digital pathology from real-world data
Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
Nature | May 2024
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
ICLR 2024 (Oral) | May 2024
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
March 2024
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
January 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
-
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Visual In-Context Prompting
Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
CVPR 2024 | November 2023
Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
ICLR 2024 | November 2023
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
October 2023
Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Proceedings of NeurIPS 2023 | October 2023
Multimodal Foundation Models: From Specialists to General-Purpose Assistants
Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
September 2023
118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Is Self-Repair a Silver Bullet for Code Generation?
Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
ICLR 2024 | June 2023
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Instruction Tuning with GPT-4
Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
MSR-TR-2023-35 | April 2023
Published by Microsoft
Project Page: https://instruction-tuning-with-gpt-4.github.io/
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
-
Efficient Long Sequence Modeling via State Space Augmented Transformer
Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
December 2022
Preprint
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
NeurIPS 2022 | November 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
NeurIPS 2022 | June 2022
Preprint
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
Efficient Self-supervised Vision Transformers for Representation Learning
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
ICLR 2022 | April 2022
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
ICLR 2022 | April 2022
Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
ArXiv | April 2022
Taming Sparsely Activated Transformer with Stochastic Experts
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
ICLR 2022 | April 2022
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
NeurIPS 2021 | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
-
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
NAACL 2022 | December 2021
ValueNet: A New Dataset for Human Value Driven Dialogue System
Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
AAAI 2022 | December 2021
RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
AAAI 2022 | December 2021
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Focal Attention for Long-Range Interactions in Vision Transformers
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
NeurIPS 2021 | December 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Taming Sparsely Activated Transformer with Stochastic Experts.
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
October 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
ICCV 2021 | October 2021
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Jianwei Yang, Yonatan Bisk, Jianfeng Gao
ICCV 2021 | October 2021
Very Deep Transformers for Neural Machine Translation
Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
October 2021
ARCH: Efficient Adversarial Regularized Training with Caching
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Targeted Adversarial Training for Natural Language Understanding
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
NAACL | June 2021
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
CVPR 2021 | June 2021
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
ArXiv | June 2021
arXiv:2106.04563
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Joint Retrieval and Generation Training for Grounded Text Generation
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
May 2021
Text Editing by Command
Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
NAACL | April 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Token-wise Curriculum Learning for Neural Machine Translation
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | March 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
A Controllable Model of Grounded Response Generation
Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
AAAI 2021 | January 2021
-
Reader-Guided Passage Reranking for Open-Domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | December 2020
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Self-supervised Pre-training with Hard Examples Improves Visual Representations.
Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
December 2020
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Generation-Augmented Retrieval for Open-domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | September 2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
EMNLP 2021 | August 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
MIND: A Large-scale Dataset for News Recommendation
Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
ACL 2020 | July 2020
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
April 2020
Feature Quantization Improves GAN Training
Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
April 2020
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
CVPR 2020 | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
-
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
The third Conversational AI workshop, NeurIPS | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
Unified Language Model Pre-training for Natural Language Understanding and Generation
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
HUBERT Untangles BERT to Improve Transfer across NLP Tasks
Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
arxiv | October 2019
https://arxiv.org/abs/1910.12647
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
September 2019
* Equal contributions
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
BioNLP 2019 | August 2019
Efficient Navigation with Language Pre-training and Stochastic Sampling
xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
EMNLP-IJCNLP | August 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
ACL | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
Association for Computational Linguistics 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
Proc. of ACL | June 2019
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Neural Approaches to Conversational AI – Tutorial at ICML 2018
ICML 2019 Tutorial | June 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
StoryGAN: A Sequential Conditional GAN for Story Visualization
Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
CVPR 2019 | April 2019
Consistent Dialogue Generation with Self-supervised Feature Learning
Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
preprint | March 2019
Jointly Optimizing Diversity and Relevance in Neural Response Generation
Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
NAACL-HLT 2019 | March 2019
Multi-Domain Task-Completion Dialog Challenge
Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
Dialog System Technology Challenges 8 | March 2019
Object-driven Text-to-Image Synthesis via Adversarial Training
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
CVPR 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
-
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
NIPS 2018 | December 2018
Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
NIPS 2018 | December 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
Deep dyna-q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
Jianfeng Gao, Michel Galley, Lihong Li
ACL and SIGIR tutorial | July 2018
ACL and SIGIR tutorial
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
Systems and methods for automated query answer generation
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
Dynamic Fusion Networks for Machine Reading Comprehension
Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
February 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
A Knowledge-Grounded Neural Conversation Model
Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
AAAI | February 2018
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
-
Language-Based Image Editing with Recurrent Attentive Models
Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
MSR-TR-2017-50 | December 2017
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Stochastic Answer Networks for Machine Reading Comprehension
Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
MSR-TR-2017-51 | December 2017
The MSR-NLP System at Dialog System Technology Challenges 6
Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
Dialog System Technology Challenges (DSTC) | November 2017
Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
IJCNLP | November 2017
Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
IJCNLP | November 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
MSR-TR-2017-36 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
SIGIR 16 | January 2017
-
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
December 2016
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
A Proposal for Evaluating Answer Distillation from Web Data
Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Deep Reinforcement Learning for Dialogue Generation
Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
Proc. of EMNLP | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
A Persona-Based Neural Conversation Model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
Proc. of ACL | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
A Diversity-Promoting Objective Function for Neural Conversation Models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
Proc. of NAACL-HLT | March 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
-
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Deep Reinforcement Learning with an Action Space Defined by Natural Language
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
ICML 2016 | November 2015
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
Proc. of ACL | July 2015
A Deep Embedding Model for Co-occurrence Learning
Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
June 2015
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
-
Learning Multi-Relational Semantics Using Neural-Embedding Models
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
NIPS 2014 workshop on Learning Semantics | December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Large-scale Expected BLEU Training of Phrase-based Reordering Models
Michael Auli, Michel Galley, Jianfeng Gao
Proc. of EMNLP | October 2014
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
MSR-TR-2014-109 | August 2014
Online Classification Using a Voted RDA Method
Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
Michael Auli, Jianfeng Gao
June 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Minimum Translation Modeling with Recurrent Neural Networks
Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
April 2014
-
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
MSR-TR-2013-89 | September 2013
Learning Semantic Representations for the Phrase Translation Model
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
MSR-TR-2013-88 | September 2013
Modeling Click-through Based Word-pairs for Web Search
Jagadeesh Jagarlamudi, Jianfeng Gao
August 2013
Query Expansion Using Path-constrained Random Walks
Jianfeng Gao, Gu Xu, Jinxi Xu
SIGIR 2013, Dublin, Ireland. | August 2013
Beyond Left-to-Right: Multiple Decomposition Structures for SMT
Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
NAACL | June 2013
Training MRF-Based Phrase Translation Models using Gradient Ascent
Jianfeng Gao, Xiaodong He
The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
End-To-End Learning of Parsing Models for Information Retrieval
Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
-
Towards Concept-based Translation Models using Search Logs for Query Expansion
Jianfeng Gao, Jian-Yun Nie
November 2012
Combining Signals for Cross-Lingual Relevance Feedback
Katrina Parton, Jianfeng Gao
AIRS2012 | August 2012
Learning Lexicon Models from Search Logs for Query Expansion
Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
Proceedings of EMNLP | July 2012
MSR SPLAT, A Language Analysis Toolkit
Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
Proceedings of NAACL-HLT 2012 | June 2012
A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
Hisami Suzuki, Jianfeng Gao
Proceedings of EMNLP | May 2012
-
Statistical Translation and Web Search Ranking
ACL/SIGIR Summer School | August 2011
Clickthrough-Based Latent Semantic Models for Web Search
Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
Domain Adaptation via Pseudo In-Domain Data Selection
Amittai Axelrod, Xiaodong He, Jianfeng Gao
EMNLP | July 2011
-
The MSRA Machine Translation System for IWSLT-2010
Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
A Large Scale Ranker-Based System for Search Query Spelling Correction
Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
The 23rd International Conference on Computational Linguistics | August 2010
A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
Alex Cheng, Fei Xia, Jianfeng Gao
Coling 2010 Organizing Committee | August 2010
A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
Multi-Style Language Model for Web Scale Information Retrieval
Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
Adapting Bboosting for Information Retrieval Measures
Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
Information Retrieval | June 2010, Vol 13: pp. 254-270
Learning Phrase-Based Spelling Error Models from Clickthrough Data
Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
ACL 2010 | May 2010
Exploring Web Scale Language models for Search Query Processing
Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
Jianfeng Gao, Xiaodong He, Jian-Yun Nie
CIKM | January 2010
-
Discovery of Term Variation in Japanese Web Search Queries
Hisami Suzuki, Xiao Li, Jianfeng Gao
Proceedings of EMNLP | August 2009
Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
EMNLP | August 2009
Smoothing Clickthrough Data for Web Search Ranking
Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
SIGIR | July 2009
Using Statistical Techniques and Web Search to Correct ESL Errors
Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
Calico Journal | June 2009, Vol 26(3)
Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
-
Ranking, Boosting, and Model Adaptation
Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
MSR-TR-2008-109 | October 2008
Selecting good expansion terms for pseudo-relevance feedback
Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
ISBN: 978-1-600558-164-4
A Web-based English Proofing System for English as a Second Language Users
Xing Yi, Jianfeng Gao, Bill Dolan
International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
In Proceedings of Coling | January 2008
Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
EMNLP | January 2008
The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
Proceedings of IJCNLP, Hyderabad, India | January 2008
-
Microsoft Research Treelet Translation System: NIST MT Evaluation 06
Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
MSR-TR-2007-144 | November 2007
MSRLM: a Scalable Language Modeling Toolkit
Patrick Nguyen, Jianfeng Gao, Milind Mahajan
MSR-TR-2007-144 | November 2007
Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
Jianfeng Gao, Hisami Suzuki
August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
Tutorial slides at the MSR Weihai Summer School, August 2007
A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
Guihong Cao, Jianfeng Gao, Jian-Yun Nie
July 2007
A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
Jianfeng Gao, Mark Johnson
January 2007
Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
CIKM | January 2007
Scalable Training of L1-Regularized Log-Linear Models
Galen Andrew, Jianfeng Gao
International Conference on Machine Learning | January 2007
-
Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
Jianfeng Gao, Jian-Yun Nie
SIGIR | October 2006
A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
ACL/SIGPARSE | April 2006
A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
Jianfeng Gao, Hisami Suzuki, Wei Yuan
Proceedings of EMNLP | April 2006
Statistical Query Translation Models for Cross- Language Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Ming Zhou
ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
A Supervised Learning Approach to Entity Search
Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
AIRS 2006 | January 2006
Approximation Lasso Methods for Language Modeling
Jianfeng Gao, Hisami Suzuki, Bin Yu
Proceedings of ACL | January 2006
-
Microsoft Research IME Corpus
Hisami Suzuki, Jianfeng Gao
MSR-TR-2005-168 | December 2005
Person Resolution in Person Search Results: WebHawk
Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
CIKM'05, Bremen, Germany | October 2005
Minimum Sample Risk Methods for Language Modeling
Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
HLT/EMNLP | October 2005
Automatic Acquisition of Chinese-English Parallel Corpus from the Web
Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
October 2005
An Information-Theoretic Approach to Automatic Evaluation of Summaries
Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
August 2005
Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
Computational Linguistics | June 2005, Vol 31(4): pp. 44
An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
Wei Yuan, Jianfeng Gao, Hisami Suzuki
IJCNLP 2005, LNAI 3651 | February 2005
A DOM Tree Alignment Model for Mining Parallel Data from the Web
Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
COLING-ACL | January 2005
-
Adaptive Chinese Word Segmentation
Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
July 2004
Dependence Language Model for Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
July 2004
Introduction to the Special Issue on Statistical Language Modeling
ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
Capturing Long Distance Dependency in Language Modeling: An Empirical Study
Jianfeng Gao, Hisami Suzuki
International Conference on Natural Language Processing | May 2004
Mining Web Logs for Actionable Knowledge
Qiang Yang, Charles X. Ling, Jianfeng Gao
Intelligent Technologies for Information Analysis | Published by Springer | 2004
The Use of SVM for Chinese New Word Identification
Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
March 2004
Linear Discriminant Model for Information Retrieval
Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
January 2004
-
Improved Source-Channel Models for Chinese Word Segmentation
Jianfeng Gao, Mu Li, Chang-Ning Huang
July 2003
Unsupervised Learning of Dependency Structure for Language Modeling
Jianfeng Gao, Hisami Suzuki
July 2003
-
Exploiting Headword Dependency and Predictive Clustering for Language Modeling
Jianfeng Gao, Hisami Suzuki, Yang Wen
Proceedings for EMNLP | July 2002
Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
SIGIR | May 2002
Exploring Asymmetric Clustering for Statistical Language Modeling
Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
ACL | May 2002
NTCIR-3 CLIR Experiments at MSRA
Hongzhao He, Jianfeng Gao
May 2002
Improving Encarta Search Engine Performance by Mining User Logs
Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
-
Improving Query Translation for CLIR Using Statistical Models
Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
SIGIR'01, New Orleans, Lousiana, USA | September 2001
TREC-10 Web Track Experiments at MSRNCN
Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
TREC-10 | May 2001
Improving the Effectiveness of Information Retrieval with Clustering and Fusion
Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
Jianfeng Gao, Joshua Goodman, Jiangbo Miao
Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
-
Distribution-based Pruning of Backoff Language Models
Jianfeng Gao, Kai-Fu Lee
October 2000
Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
Jian Zhang, Jianfeng Gao, Zhou Ming
October 2000
Language Model Compression by Predictive Clustering
Joshua Goodman, Jianfeng Gao
October 2000
Language Model Size Reduction by Pruning and Clustering
Jianfeng Gao, Joshua Goodman
Proceedings International Conference on Spoken Language Processing | October 2000
Lexicon Optimization for Chinese Language Modeling
Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
October 2000
N-gram Distribution Based Language Model Adaptation
Jianfeng Gao, Mingjing Li, Kai-Fu Lee
October 2000
PENS: A Machine-aided English Writing System for Chinese Users
Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
October 2000
On the Use of Words and N-grams for Chinese Information Retrieval
Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
September 2000
A Unified Approach to Statistical Language Modeling for Chinese
Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
June 2000
TREC-9 CLIR experiments at MSRCN
Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
TREC-9 | April 2000
-
Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
Joshua Goodman, Jianfeng Gao
April 1999
PhD Thesis: Shanghai Jiaotong University | April 1999
Publications by Research Area
-
Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
CHI 2025 | April 2025
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
ICLR 2025 | April 2025
Magma: A Foundation Model for Multimodal AI Agents
Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
February 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
NeurIPS 2024 | December 2024
SCBench: A KV Cache-Centric Analysis of Long-Context Methods
Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
ICLR 2025 | December 2024
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Smolensky, Jianfeng Gao, Roland Fernandez
2024 Neural Information Processing Systems | December 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
2024 Neural Information Processing Systems | October 2024
Crafting Interpretable Embeddings by Asking LLMs Questions
Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
NeurIPS 2024 | May 2024
A whole-slide foundation model for digital pathology from real-world data
Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
Nature | May 2024
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
ICLR 2024 (Oral) | May 2024
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
March 2024
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
ICLR 2024 | November 2023
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Proceedings of NeurIPS 2023 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Multimodal Foundation Models: From Specialists to General-Purpose Assistants
Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
September 2023
118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Is Self-Repair a Silver Bullet for Code Generation?
Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
ICLR 2024 | June 2023
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Instruction Tuning with GPT-4
Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
MSR-TR-2023-35 | April 2023
Published by Microsoft
Project Page: https://instruction-tuning-with-gpt-4.github.io/
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Efficient Long Sequence Modeling via State Space Augmented Transformer
Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
December 2022
Preprint
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
NeurIPS 2022 | November 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
NeurIPS 2022 | June 2022
Preprint
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
ArXiv | April 2022
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
ICLR 2022 | April 2022
Taming Sparsely Activated Transformer with Stochastic Experts
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
ICLR 2022 | April 2022
Efficient Self-supervised Vision Transformers for Representation Learning
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
ICLR 2022 | April 2022
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
NeurIPS 2021 | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
NAACL 2022 | December 2021
ValueNet: A New Dataset for Human Value Driven Dialogue System
Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
AAAI 2022 | December 2021
RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
AAAI 2022 | December 2021
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Focal Attention for Long-Range Interactions in Vision Transformers
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
NeurIPS 2021 | December 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Taming Sparsely Activated Transformer with Stochastic Experts.
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
October 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
ICCV 2021 | October 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Targeted Adversarial Training for Natural Language Understanding
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
NAACL | June 2021
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Joint Retrieval and Generation Training for Grounded Text Generation
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
May 2021
Text Editing by Command
Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
NAACL | April 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
A Controllable Model of Grounded Response Generation
Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
AAAI 2021 | January 2021
Reader-Guided Passage Reranking for Open-Domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | December 2020
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Self-supervised Pre-training with Hard Examples Improves Visual Representations.
Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
December 2020
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
EMNLP 2021 | August 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
MIND: A Large-scale Dataset for News Recommendation
Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
ACL 2020 | July 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
CVPR 2020 | April 2020
Feature Quantization Improves GAN Training
Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
April 2020
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
Unified Language Model Pre-training for Natural Language Understanding and Generation
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
HUBERT Untangles BERT to Improve Transfer across NLP Tasks
Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
arxiv | October 2019
https://arxiv.org/abs/1910.12647
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
September 2019
* Equal contributions
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
BioNLP 2019 | August 2019
Efficient Navigation with Language Pre-training and Stochastic Sampling
xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
EMNLP-IJCNLP | August 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
ACL | July 2019
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
Association for Computational Linguistics 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Consistent Dialogue Generation with Self-supervised Feature Learning
Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
preprint | March 2019
Multi-Domain Task-Completion Dialog Challenge
Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
Dialog System Technology Challenges 8 | March 2019
Jointly Optimizing Diversity and Relevance in Neural Response Generation
Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
NAACL-HLT 2019 | March 2019
Object-driven Text-to-Image Synthesis via Adversarial Training
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
CVPR 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
NIPS 2018 | December 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
NIPS 2018 | December 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
Jianfeng Gao, Michel Galley, Lihong Li
ACL and SIGIR tutorial | July 2018
ACL and SIGIR tutorial
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
Dynamic Fusion Networks for Machine Reading Comprehension
Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
February 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
Language-Based Image Editing with Recurrent Attentive Models
Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
MSR-TR-2017-50 | December 2017
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Stochastic Answer Networks for Machine Reading Comprehension
Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
MSR-TR-2017-51 | December 2017
The MSR-NLP System at Dialog System Technology Challenges 6
Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
Dialog System Technology Challenges (DSTC) | November 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
MSR-TR-2017-36 | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
December 2016
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
A Proposal for Evaluating Answer Distillation from Web Data
Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Deep Reinforcement Learning for Dialogue Generation
Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
Proc. of EMNLP | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
A Persona-Based Neural Conversation Model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
Proc. of ACL | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
A Diversity-Promoting Objective Function for Neural Conversation Models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
Proc. of NAACL-HLT | March 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Deep Reinforcement Learning with an Action Space Defined by Natural Language
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
ICML 2016 | November 2015
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
Proc. of ACL | July 2015
A Deep Embedding Model for Co-occurrence Learning
Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
June 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
Learning Multi-Relational Semantics Using Neural-Embedding Models
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
NIPS 2014 workshop on Learning Semantics | December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Large-scale Expected BLEU Training of Phrase-based Reordering Models
Michael Auli, Michel Galley, Jianfeng Gao
Proc. of EMNLP | October 2014
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
MSR-TR-2014-109 | August 2014
Online Classification Using a Voted RDA Method
Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Minimum Translation Modeling with Recurrent Neural Networks
Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
April 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Learning Semantic Representations for the Phrase Translation Model
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
MSR-TR-2013-88 | September 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
MSR SPLAT, A Language Analysis Toolkit
Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
Proceedings of NAACL-HLT 2012 | June 2012
Adapting Bboosting for Information Retrieval Measures
Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
Information Retrieval | June 2010, Vol 13: pp. 254-270
Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
Computational Linguistics | June 2005, Vol 31(4): pp. 44
Introduction to the Special Issue on Statistical Language Modeling
ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
-
Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
CHI 2025 | April 2025
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
ICLR 2025 | April 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
Association for Computational Linguistics 2019 | July 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Consistent Dialogue Generation with Self-supervised Feature Learning
Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
preprint | March 2019
Multi-Domain Task-Completion Dialog Challenge
Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
Dialog System Technology Challenges 8 | March 2019
Jointly Optimizing Diversity and Relevance in Neural Response Generation
Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
NAACL-HLT 2019 | March 2019
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Large-scale Expected BLEU Training of Phrase-based Reordering Models
Michael Auli, Michel Galley, Jianfeng Gao
Proc. of EMNLP | October 2014
-
Magma: A Foundation Model for Multimodal AI Agents
Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
February 2025
BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
June 2024
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
March 2024
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Visual In-Context Prompting
Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
CVPR 2024 | November 2023
BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
October 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Instruction Tuning with GPT-4
Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
MSR-TR-2023-35 | April 2023
Published by Microsoft
Project Page: https://instruction-tuning-with-gpt-4.github.io/
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
NeurIPS 2022 | November 2022
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
NeurIPS 2022 | June 2022
Preprint
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
Efficient Self-supervised Vision Transformers for Representation Learning
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
ICLR 2022 | April 2022
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
Focal Attention for Long-Range Interactions in Vision Transformers
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
NeurIPS 2021 | December 2021
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Jianwei Yang, Yonatan Bisk, Jianfeng Gao
ICCV 2021 | October 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
ICCV 2021 | October 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
CVPR 2021 | June 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
Self-supervised Pre-training with Hard Examples Improves Visual Representations.
Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
December 2020
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
September 2019
* Equal contributions
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
StoryGAN: A Sequential Conditional GAN for Story Visualization
Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
CVPR 2019 | April 2019
Object-driven Text-to-Image Synthesis via Adversarial Training
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
CVPR 2019 | February 2019
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
The MSRA Machine Translation System for IWSLT-2010
Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
An Information-Theoretic Approach to Automatic Evaluation of Summaries
Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
August 2005
-
Distribution-based Pruning of Backoff Language Models
Jianfeng Gao, Kai-Fu Lee
October 2000
PENS: A Machine-aided English Writing System for Chinese Users
Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
October 2000
N-gram Distribution Based Language Model Adaptation
Jianfeng Gao, Mingjing Li, Kai-Fu Lee
October 2000
Language Model Compression by Predictive Clustering
Joshua Goodman, Jianfeng Gao
October 2000
Lexicon Optimization for Chinese Language Modeling
Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
October 2000
Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
Jian Zhang, Jianfeng Gao, Zhou Ming
October 2000
Language Model Size Reduction by Pruning and Clustering
Jianfeng Gao, Joshua Goodman
Proceedings International Conference on Spoken Language Processing | October 2000
On the Use of Words and N-grams for Chinese Information Retrieval
Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
September 2000
A Unified Approach to Statistical Language Modeling for Chinese
Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
June 2000
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
SCBench: A KV Cache-Centric Analysis of Long-Context Methods
Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
ICLR 2025 | December 2024
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
Efficient Long Sequence Modeling via State Space Augmented Transformer
Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
December 2022
Preprint
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
ArXiv | April 2022
Taming Sparsely Activated Transformer with Stochastic Experts
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
ICLR 2022 | April 2022
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
NAACL 2022 | December 2021
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Taming Sparsely Activated Transformer with Stochastic Experts.
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
October 2021
Very Deep Transformers for Neural Machine Translation
Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
October 2021
ARCH: Efficient Adversarial Regularized Training with Caching
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
ArXiv | June 2021
arXiv:2106.04563
Text Editing by Command
Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
NAACL | April 2021
Token-wise Curriculum Learning for Neural Machine Translation
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | March 2021
A Controllable Model of Grounded Response Generation
Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
AAAI 2021 | January 2021
Reader-Guided Passage Reranking for Open-Domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | December 2020
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Generation-Augmented Retrieval for Open-domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | September 2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
EMNLP 2021 | August 2020
MIND: A Large-scale Dataset for News Recommendation
Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
ACL 2020 | July 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
The third Conversational AI workshop, NeurIPS | December 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
HUBERT Untangles BERT to Improve Transfer across NLP Tasks
Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
arxiv | October 2019
https://arxiv.org/abs/1910.12647
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
ACL | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
Association for Computational Linguistics 2019 | July 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Neural Approaches to Conversational AI – Tutorial at ICML 2018
ICML 2019 Tutorial | June 2019
Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
Proc. of ACL | June 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
Consistent Dialogue Generation with Self-supervised Feature Learning
Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
preprint | March 2019
Multi-Domain Task-Completion Dialog Challenge
Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
Dialog System Technology Challenges 8 | March 2019
Jointly Optimizing Diversity and Relevance in Neural Response Generation
Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
NAACL-HLT 2019 | March 2019
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
NIPS 2018 | December 2018
Deep dyna-q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
A Knowledge-Grounded Neural Conversation Model
Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
AAAI | February 2018
The MSR-NLP System at Dialog System Technology Challenges 6
Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
Dialog System Technology Challenges (DSTC) | November 2017
Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
IJCNLP | November 2017
Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
IJCNLP | November 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
December 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
Deep Reinforcement Learning for Dialogue Generation
Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
Proc. of EMNLP | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
A Persona-Based Neural Conversation Model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
Proc. of ACL | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
A Diversity-Promoting Objective Function for Neural Conversation Models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
Proc. of NAACL-HLT | March 2016
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
Proc. of ACL | July 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
MSR-TR-2014-109 | August 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Learning Semantic Representations for the Phrase Translation Model
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
MSR-TR-2013-88 | September 2013
A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
MSR-TR-2013-89 | September 2013
Beyond Left-to-Right: Multiple Decomposition Structures for SMT
Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
NAACL | June 2013
Training MRF-Based Phrase Translation Models using Gradient Ascent
Jianfeng Gao, Xiaodong He
The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
End-To-End Learning of Parsing Models for Information Retrieval
Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
MSR SPLAT, A Language Analysis Toolkit
Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
Proceedings of NAACL-HLT 2012 | June 2012
A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
Hisami Suzuki, Jianfeng Gao
Proceedings of EMNLP | May 2012
A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
Jianfeng Gao, Xiaodong He, Jian-Yun Nie
CIKM | January 2010
Discovery of Term Variation in Japanese Web Search Queries
Hisami Suzuki, Xiao Li, Jianfeng Gao
Proceedings of EMNLP | August 2009
Smoothing Clickthrough Data for Web Search Ranking
Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
SIGIR | July 2009
Using Statistical Techniques and Web Search to Correct ESL Errors
Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
Calico Journal | June 2009, Vol 26(3)
Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
Ranking, Boosting, and Model Adaptation
Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
MSR-TR-2008-109 | October 2008
Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
Proceedings of IJCNLP, Hyderabad, India | January 2008
The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
MSRLM: a Scalable Language Modeling Toolkit
Patrick Nguyen, Jianfeng Gao, Milind Mahajan
MSR-TR-2007-144 | November 2007
Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
Jianfeng Gao, Hisami Suzuki
August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
Tutorial slides at the MSR Weihai Summer School, August 2007
A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
ACL/SIGPARSE | April 2006
A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
Jianfeng Gao, Hisami Suzuki, Wei Yuan
Proceedings of EMNLP | April 2006
A Supervised Learning Approach to Entity Search
Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
AIRS 2006 | January 2006
Approximation Lasso Methods for Language Modeling
Jianfeng Gao, Hisami Suzuki, Bin Yu
Proceedings of ACL | January 2006
Microsoft Research IME Corpus
Hisami Suzuki, Jianfeng Gao
MSR-TR-2005-168 | December 2005
Automatic Acquisition of Chinese-English Parallel Corpus from the Web
Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
October 2005
An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
Wei Yuan, Jianfeng Gao, Hisami Suzuki
IJCNLP 2005, LNAI 3651 | February 2005
Adaptive Chinese Word Segmentation
Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
July 2004
Dependence Language Model for Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
July 2004
Introduction to the Special Issue on Statistical Language Modeling
ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
Capturing Long Distance Dependency in Language Modeling: An Empirical Study
Jianfeng Gao, Hisami Suzuki
International Conference on Natural Language Processing | May 2004
The Use of SVM for Chinese New Word Identification
Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
March 2004
Linear Discriminant Model for Information Retrieval
Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
January 2004
Unsupervised Learning of Dependency Structure for Language Modeling
Jianfeng Gao, Hisami Suzuki
July 2003
Improved Source-Channel Models for Chinese Word Segmentation
Jianfeng Gao, Mu Li, Chang-Ning Huang
July 2003
Exploiting Headword Dependency and Predictive Clustering for Language Modeling
Jianfeng Gao, Hisami Suzuki, Yang Wen
Proceedings for EMNLP | July 2002
-
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
NeurIPS 2024 | December 2024
A whole-slide foundation model for digital pathology from real-world data
Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
Nature | May 2024
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
March 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020
DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
BioNLP 2019 | August 2019
-
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
-
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Systems and methods for automated query answer generation
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
SIGIR 16 | January 2017
A Proposal for Evaluating Answer Distillation from Web Data
Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
Learning Multi-Relational Semantics Using Neural-Embedding Models
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
NIPS 2014 workshop on Learning Semantics | December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Modeling Click-through Based Word-pairs for Web Search
Jagadeesh Jagarlamudi, Jianfeng Gao
August 2013
Query Expansion Using Path-constrained Random Walks
Jianfeng Gao, Gu Xu, Jinxi Xu
SIGIR 2013, Dublin, Ireland. | August 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Towards Concept-based Translation Models using Search Logs for Query Expansion
Jianfeng Gao, Jian-Yun Nie
November 2012
Combining Signals for Cross-Lingual Relevance Feedback
Katrina Parton, Jianfeng Gao
AIRS2012 | August 2012
Learning Lexicon Models from Search Logs for Query Expansion
Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
Proceedings of EMNLP | July 2012
Statistical Translation and Web Search Ranking
ACL/SIGIR Summer School | August 2011
Clickthrough-Based Latent Semantic Models for Web Search
Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
Learning Phrase-Based Spelling Error Models from Clickthrough Data
Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
ACL 2010 | May 2010
Exploring Web Scale Language models for Search Query Processing
Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
Jianfeng Gao, Xiaodong He, Jian-Yun Nie
CIKM | January 2010
Selecting good expansion terms for pseudo-relevance feedback
Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
ISBN: 978-1-600558-164-4
Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
In Proceedings of Coling | January 2008
A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
Guihong Cao, Jianfeng Gao, Jian-Yun Nie
July 2007
A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
Jianfeng Gao, Mark Johnson
January 2007
-
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
MSR-TR-2013-89 | September 2013
A Large Scale Ranker-Based System for Search Query Spelling Correction
Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
The 23rd International Conference on Computational Linguistics | August 2010
-
Targeted Adversarial Training for Natural Language Understanding
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
NAACL | June 2021
-
Improving Query Translation for CLIR Using Statistical Models
Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
SIGIR'01, New Orleans, Lousiana, USA | September 2001
TREC-10 Web Track Experiments at MSRNCN
Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
TREC-10 | May 2001
Improving the Effectiveness of Information Retrieval with Clustering and Fusion
Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
Jianfeng Gao, Joshua Goodman, Jiangbo Miao
Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
TREC-9 CLIR experiments at MSRCN
Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
TREC-9 | April 2000
Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
Joshua Goodman, Jianfeng Gao
April 1999
PhD Thesis: Shanghai Jiaotong University | April 1999
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
StoryGAN: A Sequential Conditional GAN for Story Visualization
Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
CVPR 2019 | April 2019
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
MSR-TR-2013-89 | September 2013
Towards Concept-based Translation Models using Search Logs for Query Expansion
Jianfeng Gao, Jian-Yun Nie
November 2012
Combining Signals for Cross-Lingual Relevance Feedback
Katrina Parton, Jianfeng Gao
AIRS2012 | August 2012
A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
Alex Cheng, Fei Xia, Jianfeng Gao
Coling 2010 Organizing Committee | August 2010
Multi-Style Language Model for Web Scale Information Retrieval
Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
EMNLP | August 2009
Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
A Web-based English Proofing System for English as a Second Language Users
Xing Yi, Jianfeng Gao, Bill Dolan
International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
Microsoft Research Treelet Translation System: NIST MT Evaluation 06
Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
MSR-TR-2007-144 | November 2007
Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
CIKM | January 2007
Scalable Training of L1-Regularized Log-Linear Models
Galen Andrew, Jianfeng Gao
International Conference on Machine Learning | January 2007
Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
Jianfeng Gao, Jian-Yun Nie
SIGIR | October 2006
Statistical Query Translation Models for Cross- Language Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Ming Zhou
ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
Person Resolution in Person Search Results: WebHawk
Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
CIKM'05, Bremen, Germany | October 2005
Minimum Sample Risk Methods for Language Modeling
Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
HLT/EMNLP | October 2005
A DOM Tree Alignment Model for Mining Parallel Data from the Web
Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
COLING-ACL | January 2005
Introduction to the Special Issue on Statistical Language Modeling
ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
Mining Web Logs for Actionable Knowledge
Qiang Yang, Charles X. Ling, Jianfeng Gao
Intelligent Technologies for Information Analysis | Published by Springer | 2004
Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
SIGIR | May 2002
Exploring Asymmetric Clustering for Statistical Language Modeling
Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
ACL | May 2002
NTCIR-3 CLIR Experiments at MSRA
Hongzhao He, Jianfeng Gao
May 2002
Improving Encarta Search Engine Performance by Mining User Logs
Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
-
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
-
Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
NIPS 2018 | December 2018
Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
Michael Auli, Jianfeng Gao
June 2014
Domain Adaptation via Pseudo In-Domain Data Selection
Amittai Axelrod, Xiaodong He, Jianfeng Gao
EMNLP | July 2011
Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
EMNLP | January 2008
-
A Persona-Based Neural Conversation Model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
Proc. of ACL | June 2016
Publications by Type
-
Improving Query Translation for CLIR Using Statistical Models
Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
SIGIR'01, New Orleans, Lousiana, USA | September 2001
TREC-10 Web Track Experiments at MSRNCN
Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
TREC-10 | May 2001
Distribution-based Pruning of Backoff Language Models
Jianfeng Gao, Kai-Fu Lee
October 2000
PENS: A Machine-aided English Writing System for Chinese Users
Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
October 2000
N-gram Distribution Based Language Model Adaptation
Jianfeng Gao, Mingjing Li, Kai-Fu Lee
October 2000
Language Model Compression by Predictive Clustering
Joshua Goodman, Jianfeng Gao
October 2000
Lexicon Optimization for Chinese Language Modeling
Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
October 2000
Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
Jian Zhang, Jianfeng Gao, Zhou Ming
October 2000
Language Model Size Reduction by Pruning and Clustering
Jianfeng Gao, Joshua Goodman
Proceedings International Conference on Spoken Language Processing | October 2000
On the Use of Words and N-grams for Chinese Information Retrieval
Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
September 2000
A Unified Approach to Statistical Language Modeling for Chinese
Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
June 2000
TREC-9 CLIR experiments at MSRCN
Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
TREC-9 | April 2000
Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
CHI 2025 | April 2025
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
ICLR 2025 | April 2025
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
NeurIPS 2024 | December 2024
SCBench: A KV Cache-Centric Analysis of Long-Context Methods
Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
ICLR 2025 | December 2024
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Smolensky, Jianfeng Gao, Roland Fernandez
2024 Neural Information Processing Systems | December 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
ICLR 2025 | November 2024
DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
2024 Neural Information Processing Systems | October 2024
Crafting Interpretable Embeddings by Asking LLMs Questions
Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
NeurIPS 2024 | May 2024
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
ICLR 2024 (Oral) | May 2024
Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
arXiv: 2403.00833 | February 2024
An Interactive Agent Foundation Model
Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
February 2024
TrustLLM: Trustworthiness in Large Language Models
Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
ICML 2024 | January 2024
MindAgent: Emergent Gaming Interaction
Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
Processings of NAACL 2024 | January 2024
Agent AI: Surveying the Horizons of Multimodal Interaction
Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
arXiv: 2401.03568 | January 2024
Bridging Discrete and Backpropagation: Straight-Through and Beyond
Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
NeurIPS 2023 (Oral) | December 2023
Visual In-Context Prompting
Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
CVPR 2024 | November 2023
Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
ICLR 2024 | November 2023
Tree Prompting: Efficient Task Adaptation without Fine-Tuning
EMNLP | November 2023
Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Proceedings of NeurIPS 2023 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Is Self-Repair a Silver Bullet for Code Generation?
Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
ICLR 2024 | June 2023
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
Proceedings of ACL 2023 | May 2023
AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
ACL | May 2023
ArK: Augmented Reality with Knowledge Emergent Infrastructure
Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2022 | December 2022
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
NeurIPS 2022 | November 2022
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
NeurIPS 2022 | November 2022
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
RegionCLIP: Region-based Language-Image Pretraining
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
CVPR 2022 | June 2022
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
NeurIPS 2022 | June 2022
Preprint
Grounded Language-Image Pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
CVPR | June 2022
Unified Contrastive Learning in Image-Text-Label Space
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
CVPR 2022 | June 2022
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
K-LITE: Learning Transferable Visual Models with External Knowledge
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
NeurIPS 2022 | April 2022
Oral Presentation (1%)
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
NeurIPS (Datasets and Benchmarks Track) | April 2022
Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
ICLR 2022 | April 2022
Taming Sparsely Activated Transformer with Stochastic Experts
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
ICLR 2022 | April 2022
Efficient Self-supervised Vision Transformers for Representation Learning
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
ICLR 2022 | April 2022
FocalNet: Focal Modulation Networks
Jianwei Yang, Chunyuan Li, Jianfeng Gao
2022 Neural Information Processing Systems | March 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
NeurIPS 2021 | March 2022
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
NAACL 2022. Long paper, Oral. | January 2022
No.1 of OK-VQA Leaderboard (2021).
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
NAACL 2022 | December 2021
ValueNet: A New Dataset for Human Value Driven Dialogue System
Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
AAAI 2022 | December 2021
RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
AAAI 2022 | December 2021
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Focal Attention for Long-Range Interactions in Vision Transformers
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
NeurIPS 2021 | December 2021
NICE: Neural Image Commenting with Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
EMNLP 2021 | October 2021
Taming Sparsely Activated Transformer with Stochastic Experts.
Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
October 2021
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
Jianwei Yang, Yonatan Bisk, Jianfeng Gao
ICCV 2021 | October 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
ICCV 2021 | October 2021
ARCH: Efficient Adversarial Regularized Training with Caching
Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Go-Figure: A Meta Evaluation of Factuality in Summarization
Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
KB-VLP: Knowledge Based Vision and Language Pretraining
Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
VinVL: Revisiting Visual Representations in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
CVPR 2021 | June 2021
Targeted Adversarial Training for Natural Language Understanding
Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
NAACL | June 2021
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
CVPR 2021 | June 2021
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Text Editing by Command
Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
NAACL | April 2021
Contrastive Multi-document Question Generation
Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
European Chapter of the Association for Computational Linguistics (EACL) | April 2021
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
Transactions of the Association for Computational Linguistics | April 2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
AAAI 2021 | April 2021
Token-wise Curriculum Learning for Neural Machine Translation
Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
2021 Empirical Methods in Natural Language Processing | March 2021
Multi-domain Task-oriented Dialog Challenge II at DSTC9
Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
AAAI | February 2021
A Controllable Model of Grounded Response Generation
Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
AAAI 2021 | January 2021
Reader-Guided Passage Reranking for Open-Domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | December 2020
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Learning Inference Rules with Neural TP-Reasoner
Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, workshop | December 2020
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Generation-Augmented Retrieval for Open-domain Question Answering
Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
ACL-IJCNLP 2021 | September 2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings
Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
EMNLP 2021 | August 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Recent Advances in Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett
SIGIR 2020 | July 2020
Tutorial Slides
MIND: A Large-scale Dataset for News Recommendation
Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
ACL 2020 | July 2020
Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
ICML 2020 | July 2020
Few-Shot Generative Conversational Query Rewriting
Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
SIGIR 2020 | June 2020
Best Short Paper Award
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
CVPR 2020 | April 2020
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
Eighth International Conference on Learning Representations (ICLR) | April 2020
On the Variance of the Adaptive Learning Rate and Beyond
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
ACL 2020 Demo | April 2020
Multi-domain Task-oriented Dialog Challenge II
Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
The Ninth Dialog System Technology Challenge | March 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
Results of the Multi-Domain Task-Completion Dialog Challenge
Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
Complementary Auxiliary Classifiers for Label-Conditional Text Generation
Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
AAAI 2020 | February 2020
Unified Vision-Language Pre-Training for Image Captioning and VQA
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
The third Conversational AI workshop, NeurIPS | December 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
Best Paper Award at KR2ML Workshop in NeurIPS 2019.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
Structuring Latent Spaces for Stylized Response Generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
EMNLP-IJCNLP 2019 | September 2019
DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
BioNLP 2019 | August 2019
Efficient Navigation with Language Pre-training and Stochastic Sampling
xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
EMNLP-IJCNLP | August 2019
Budgeted Policy Learning for Task-Oriented Dialogue Systems
Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
ACL 2019 | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
ACL | July 2019
ConvLab: Multi-Domain End-to-End Dialog System Platform
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
Association for Computational Linguistics 2019 | July 2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019 | July 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
CVPR 2019 | June 2019
Oral
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Neural Approaches to Conversational AI – Tutorial at ICML 2018
ICML 2019 Tutorial | June 2019
Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
Proc. of ACL | June 2019
Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
StoryGAN: A Sequential Conditional GAN for Story Visualization
Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
CVPR 2019 | April 2019
Consistent Dialogue Generation with Self-supervised Feature Learning
Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
preprint | March 2019
Multi-Domain Task-Completion Dialog Challenge
Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
Dialog System Technology Challenges 8 | March 2019
Jointly Optimizing Diversity and Relevance in Neural Response Generation
Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
NAACL-HLT 2019 | March 2019
Object-driven Text-to-Image Synthesis via Adversarial Training
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
CVPR 2019 | February 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
NAACL 2019 | February 2019
Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
AAAI 2019 | January 2019
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
AAAI 2019 | January 2019
Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
NeurIPS 2018 | December 2018
Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
NIPS 2018 | December 2018
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
NIPS 2018 | December 2018
Deep dyna-q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
EMNLP 2018 | October 2018
Subgoal Discovery for Hierarchical Dialogue Policy Learning
Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
EMNLP 2018 | October 2018
Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
SLT 2018 | July 2018
Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
Jianfeng Gao, Michel Galley, Lihong Li
ACL and SIGIR tutorial | July 2018
ACL and SIGIR tutorial
Discourse-Aware Neural Rewards for Coherent Text Generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
ICASSP 2018 | April 2018
BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
AAAI 2018 | February 2018
A Knowledge-Grounded Neural Conversation Model
Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
AAAI | February 2018
Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
ACL 2018 | January 2018
Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
IJCNLP | November 2017
Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
IJCNLP | November 2017
End-to-End Task-Completion Neural Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
the 8th International Joint Conference on Natural Language Processing | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
ReasoNet: Learning to Stop Reading in Machine Comprehension
Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
StyleNet: Generating Attractive Visual Captions with Styles
Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
Semantic Compositional Networks for Visual Captioning
Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
A Nested Attention Neural Hybrid Model for Grammatical Error Correction
ACL 2017 | July 2017
End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
Character-level Deep Conflation for Business Data Analytics
Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
ICASSP 2017 | February 2017
Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
SIGIR 16 | January 2017
Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
December 2016
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
EMNLP 2016 | November 2016
Bi-directional Attention with Agreement for Dependency Parsing
Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
EMNLP | November 2016
Deep Reinforcement Learning with a Natural Language Action Space
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
ECCV 2016 | August 2016
Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
IJCAI 2016 | July 2016
A Proposal for Evaluating Answer Distillation from Web Data
Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Deep Reinforcement Learning for Dialogue Generation
Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
Proc. of EMNLP | June 2016
Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
A Persona-Based Neural Conversation Model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
Proc. of ACL | June 2016
Reasoning in Vector Space: An Exploratory Study of Question Answering
Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
A Diversity-Promoting Objective Function for Neural Conversation Models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
Proc. of NAACL-HLT | March 2016
Basic Reasoning with Tensor Product Representations
Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
January 2016
End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
NIPS | December 2015
Deep Reinforcement Learning with an Action Space Defined by Natural Language
Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
ICML 2016 | November 2015
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
Outstanding Paper Award
ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
Proc. of ACL | July 2015
A Deep Embedding Model for Co-occurrence Learning
Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
June 2015
From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
CVPR 2015 | June 2015
Tied for 1st Prize
A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
May 2015
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
Learning Multi-Relational Semantics Using Neural-Embedding Models
Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
NIPS 2014 workshop on Learning Semantics | December 2014
A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
CIKM | November 2014
Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
Xiaodong He, Jianfeng Gao, Li Deng
CIKM | November 2014
Large-scale Expected BLEU Training of Phrase-based Reordering Models
Michael Auli, Michel Galley, Jianfeng Gao
Proc. of EMNLP | October 2014
Online Classification Using a Voted RDA Method
Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
Learning Continuous Phrase Representations for Translation Modeling
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
Proceedings of ACL | June 2014
Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
Michael Auli, Jianfeng Gao
June 2014
Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
Learning Semantic Representations Using Convolutional Neural Networks for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
April 2014
Minimum Translation Modeling with Recurrent Neural Networks
Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
April 2014
Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
October 2013
Modeling Click-through Based Word-pairs for Web Search
Jagadeesh Jagarlamudi, Jianfeng Gao
August 2013
Query Expansion Using Path-constrained Random Walks
Jianfeng Gao, Gu Xu, Jinxi Xu
SIGIR 2013, Dublin, Ireland. | August 2013
Beyond Left-to-Right: Multiple Decomposition Structures for SMT
Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
NAACL | June 2013
Training MRF-Based Phrase Translation Models using Gradient Ascent
Jianfeng Gao, Xiaodong He
The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
Deep Stacking Networks for Information Retrieval
Li Deng, Xiaodong He, Jianfeng Gao
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
End-To-End Learning of Parsing Models for Information Retrieval
Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Towards Concept-based Translation Models using Search Logs for Query Expansion
Jianfeng Gao, Jian-Yun Nie
November 2012
Combining Signals for Cross-Lingual Relevance Feedback
Katrina Parton, Jianfeng Gao
AIRS2012 | August 2012
Learning Lexicon Models from Search Logs for Query Expansion
Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
Proceedings of EMNLP | July 2012
MSR SPLAT, A Language Analysis Toolkit
Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
Proceedings of NAACL-HLT 2012 | June 2012
A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
Hisami Suzuki, Jianfeng Gao
Proceedings of EMNLP | May 2012
Statistical Translation and Web Search Ranking
ACL/SIGIR Summer School | August 2011
Clickthrough-Based Latent Semantic Models for Web Search
Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
Domain Adaptation via Pseudo In-Domain Data Selection
Amittai Axelrod, Xiaodong He, Jianfeng Gao
EMNLP | July 2011
The MSRA Machine Translation System for IWSLT-2010
Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
A Large Scale Ranker-Based System for Search Query Spelling Correction
Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
The 23rd International Conference on Computational Linguistics | August 2010
A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
Alex Cheng, Fei Xia, Jianfeng Gao
Coling 2010 Organizing Committee | August 2010
A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
Multi-Style Language Model for Web Scale Information Retrieval
Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
Learning Phrase-Based Spelling Error Models from Clickthrough Data
Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
ACL 2010 | May 2010
Exploring Web Scale Language models for Search Query Processing
Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
Jianfeng Gao, Xiaodong He, Jian-Yun Nie
CIKM | January 2010
Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
EMNLP | August 2009
Discovery of Term Variation in Japanese Web Search Queries
Hisami Suzuki, Xiao Li, Jianfeng Gao
Proceedings of EMNLP | August 2009
Smoothing Clickthrough Data for Web Search Ranking
Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
SIGIR | July 2009
Selecting good expansion terms for pseudo-relevance feedback
Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
ISBN: 978-1-600558-164-4
Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
Proceedings of IJCNLP, Hyderabad, India | January 2008
Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
In Proceedings of Coling | January 2008
Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
EMNLP | January 2008
The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
A Web-based English Proofing System for English as a Second Language Users
Xing Yi, Jianfeng Gao, Bill Dolan
International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
Guihong Cao, Jianfeng Gao, Jian-Yun Nie
July 2007
Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
CIKM | January 2007
A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
Jianfeng Gao, Mark Johnson
January 2007
Scalable Training of L1-Regularized Log-Linear Models
Galen Andrew, Jianfeng Gao
International Conference on Machine Learning | January 2007
A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
Jianfeng Gao, Jian-Yun Nie
SIGIR | October 2006
A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
ACL/SIGPARSE | April 2006
A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
Jianfeng Gao, Hisami Suzuki, Wei Yuan
Proceedings of EMNLP | April 2006
A Supervised Learning Approach to Entity Search
Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
AIRS 2006 | January 2006
Approximation Lasso Methods for Language Modeling
Jianfeng Gao, Hisami Suzuki, Bin Yu
Proceedings of ACL | January 2006
Person Resolution in Person Search Results: WebHawk
Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
CIKM'05, Bremen, Germany | October 2005
Minimum Sample Risk Methods for Language Modeling
Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
HLT/EMNLP | October 2005
Automatic Acquisition of Chinese-English Parallel Corpus from the Web
Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
October 2005
An Information-Theoretic Approach to Automatic Evaluation of Summaries
Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
August 2005
An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
Wei Yuan, Jianfeng Gao, Hisami Suzuki
IJCNLP 2005, LNAI 3651 | February 2005
A DOM Tree Alignment Model for Mining Parallel Data from the Web
Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
COLING-ACL | January 2005
Adaptive Chinese Word Segmentation
Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
July 2004
Dependence Language Model for Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
July 2004
Capturing Long Distance Dependency in Language Modeling: An Empirical Study
Jianfeng Gao, Hisami Suzuki
International Conference on Natural Language Processing | May 2004
The Use of SVM for Chinese New Word Identification
Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
March 2004
Linear Discriminant Model for Information Retrieval
Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
January 2004
Unsupervised Learning of Dependency Structure for Language Modeling
Jianfeng Gao, Hisami Suzuki
July 2003
Improved Source-Channel Models for Chinese Word Segmentation
Jianfeng Gao, Mu Li, Chang-Ning Huang
July 2003
Exploiting Headword Dependency and Predictive Clustering for Language Modeling
Jianfeng Gao, Hisami Suzuki, Yang Wen
Proceedings for EMNLP | July 2002
Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
SIGIR | May 2002
Exploring Asymmetric Clustering for Statistical Language Modeling
Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
ACL | May 2002
NTCIR-3 CLIR Experiments at MSRA
Hongzhao He, Jianfeng Gao
May 2002
-
Magma: A Foundation Model for Multimodal AI Agents
Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
February 2025
CollabLLM: From Passive Responders to Active Collaborators
Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
February 2025
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
March 2024
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
January 2024
BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
October 2023
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Interactive Code Generation via Test-Driven User-Intent Formalization
Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
August 2022
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
May 2022
Self-supervised Pre-training with Hard Examples Improves Visual Representations.
Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
December 2020
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020
Novel Human-Object Interaction Detection via Adversarial Domain Generalization
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
May 2020
OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
April 2020
Feature Quantization Improves GAN Training
Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
April 2020
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Systems and methods for automated query answer generation
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Dynamic Fusion Networks for Machine Reading Comprehension
Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
February 2018
Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
May 2015
-
ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
MSR-TR-2024-63 | October 2024
Published by Microsoft
Instruction Tuning with GPT-4
Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
MSR-TR-2023-35 | April 2023
Published by Microsoft
Project Page: https://instruction-tuning-with-gpt-4.github.io/
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
MSR-TR-2020-49 | November 2020
Published by Microsoft
The participation report of our top non-manual entry in TREC COVID Round 2.
The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Published by Microsoft
Language-Based Image Editing with Recurrent Attentive Models
Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
MSR-TR-2017-50 | December 2017
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Stochastic Answer Networks for Machine Reading Comprehension
Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
MSR-TR-2017-51 | December 2017
Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
MSR-TR-2017-36 | July 2017
Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
MSR-TR-2016-61 | September 2016
arXiv:1609.03286
End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
MSR-TR-2016-63 | September 2016
Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
MSR-TR-2016-62 | August 2016
arXiv:1608.05081
Recurrent Reinforcement Learning: A Hybrid Approach
Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
MSR-TR-2015-98 | September 2015
Proceedings of COLING-94, Kyoto, Japan
Deep Learning for Web Search and Natural Language Processing
Jianfeng Gao, Xiaodong He, Li Deng
MSR-TR-2015-7 | January 2015
Modeling Interestingness with Deep Neural Networks
Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
MSR-TR-2014-56 | October 2014
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
MSR-TR-2014-109 | August 2014
A Convolutional Latent Semantic Model for Web Search
Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
MSR-TR-2014-55 | April 2014
Learning Semantic Representations for the Phrase Translation Model
Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
MSR-TR-2013-88 | September 2013
A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
MSR-TR-2013-89 | September 2013
Ranking, Boosting, and Model Adaptation
Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
MSR-TR-2008-109 | October 2008
Microsoft Research Treelet Translation System: NIST MT Evaluation 06
Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
MSR-TR-2007-144 | November 2007
MSRLM: a Scalable Language Modeling Toolkit
Patrick Nguyen, Jianfeng Gao, Milind Mahajan
MSR-TR-2007-144 | November 2007
Microsoft Research IME Corpus
Hisami Suzuki, Jianfeng Gao
MSR-TR-2005-168 | December 2005
-
BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
June 2024
Efficient Long Sequence Modeling via State Space Augmented Transformer
Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
December 2022
Preprint
Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, Jyoti Aneja, Jianfeng Gao
October 2022
Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
September 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
June 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
April 2022
arXiv:2204.06644
Very Deep Transformers for Neural Machine Translation
Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
October 2021
Joint Retrieval and Generation Training for Grounded Text Generation
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
May 2021
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
September 2019
* Equal contributions
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
February 2018
arXiv preprint
Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
Jianfeng Gao, Hisami Suzuki
August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
Tutorial slides at the MSR Weihai Summer School, August 2007
-
Improving the Effectiveness of Information Retrieval with Clustering and Fusion
Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
Jianfeng Gao, Joshua Goodman, Jiangbo Miao
Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
A whole-slide foundation model for digital pathology from real-world data
Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
Nature | May 2024
LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
EMNLP | December 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
ArXiv | April 2022
LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
NAACL 2022 | April 2022
Florence: A New Foundation Model for Computer Vision
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
arXiv preprint arXiv:2111.11432 | November 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
ArXiv | June 2021
arXiv:2106.04563
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv preprint arXiv:2012.06946 | December 2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
HUBERT Untangles BERT to Improve Transfer across NLP Tasks
Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
arxiv | October 2019
https://arxiv.org/abs/1910.12647
Neural Approaches to Conversational AI
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Link Prediction using Embedded Knowledge Graphs
Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
arXiv | April 2018
The MSR-NLP System at Dialog System Technology Challenges 6
Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
Dialog System Technology Challenges (DSTC) | November 2017
Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
March 2017
A User Simulator for Task-Completion Dialogues
Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
December 2016, pp. 14
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
November 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
Adapting Bboosting for Information Retrieval Measures
Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
Information Retrieval | June 2010, Vol 13: pp. 254-270
Using Statistical Techniques and Web Search to Correct ESL Errors
Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
Calico Journal | June 2009, Vol 26(3)
Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
Statistical Query Translation Models for Cross- Language Information Retrieval
Jianfeng Gao, Jian-Yun Nie, Ming Zhou
ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
Computational Linguistics | June 2005, Vol 31(4): pp. 44
Introduction to the Special Issue on Statistical Language Modeling
ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
Improving Encarta Search Engine Performance by Mining User Logs
Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
-
Multimodal Foundation Models: From Specialists to General-Purpose Assistants
Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
September 2023
118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
Neural Approaches to Conversational Information Retrieval
Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
Published by Springer | March 2023, Vol 44
ISBN: 978-3-031-23079-0
The Information Retrieval Series.
-
Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
Joshua Goodman, Jianfeng Gao
April 1999
PhD Thesis: Shanghai Jiaotong University | April 1999
-
Mining Web Logs for Actionable Knowledge
Qiang Yang, Charles X. Ling, Jianfeng Gao
Intelligent Technologies for Information Analysis | Published by Springer | 2004