VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Publications
Publications
Publications par année
-
-
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
-
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
-
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
-
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
Filtre par zone de recherche
-
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016
-
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
-
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
-
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
-
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Publication Type
-
VLC: Training Vision-Language Transformers from Captions
Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
Proceedings of Transactions on Machine Learning Research | May 2022
Vision-Language Navigation Policy Learning and Adaptation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
-
NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
EMNLP 2019 | November 2019
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
CVPR 2019 | June 2019
Best Student Paper Award in CVPR 2019.
Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation
Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He
AAAI 2019 | January 2019
Turbo Learning for CaptionBot and DrawingBot
Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang
NeurIPS 2018 | December 2018
Stacked Attention Networks for Image Question Answering
Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
CVPR 2016 | June 2016