DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
April 2021
Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He
April 2021
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
May 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao
April 2020
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
Jon Soifer, Minjia Zhang, Zehua Hu, Menghao Li, Jeffrey Zhu, Elton Zheng, Mingqin Li, Jason Li, Yuxiong He
December 2019
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Jeffrey Zhu, Mingqin Li
November 2019
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
Jason Li
October 2019
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul Bennett, Nick Craswell, Saurabh Tiwary
The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) | July 2019
Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, Emine Yilmaz
July 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, Thomas Liu, Junhua Wang
2019 USENIX Conference on Operational Machine Learning (OpML ’19) | May 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
Proceedings of the 42nd international ACM SIGIR conference on Research & development in information retrieval | April 2019
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Publié par Microsoft
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Corby Rosset, Damien Jose, Gargi Ghosh, Bhaskar Mitra, Saurabh Tiwary
Proceedings of the 41st international ACM SIGIR conference on Research & development in information retrieval | May 2018
Eric Chung, Jeremy Fowers, Kalin Ovtcharov, Michael Papamichael, Adrian Caulfield, Todd Massengill, Ming Liu, Mahdi Ghandi, Daniel Lo, Steve Reinhardt, Shlomi Alkalay, Hari Angepat, Derek Chiou, Alessandro Forin, Doug Burger, Lisa Woods, Gabriel Weisz, Michael Haselman, Dan Zhang
IEEE Micro | March 2018, Vol 38: pp. 8-20
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18) | November 2017
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
April 2021
Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He
April 2021
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
May 2020
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao
April 2020
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
Jon Soifer, Minjia Zhang, Zehua Hu, Menghao Li, Jeffrey Zhu, Elton Zheng, Mingqin Li, Jason Li, Yuxiong He
December 2019
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Jeffrey Zhu, Mingqin Li
November 2019
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
Jason Li
October 2019
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul Bennett, Nick Craswell, Saurabh Tiwary
The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) | July 2019
Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, Emine Yilmaz
July 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, Thomas Liu, Junhua Wang
2019 USENIX Conference on Operational Machine Learning (OpML ’19) | May 2019
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
Proceedings of the 42nd international ACM SIGIR conference on Research & development in information retrieval | April 2019
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Publié par Microsoft
Corby Rosset, Damien Jose, Gargi Ghosh, Bhaskar Mitra, Saurabh Tiwary
Proceedings of the 41st international ACM SIGIR conference on Research & development in information retrieval | May 2018
Eric Chung, Jeremy Fowers, Kalin Ovtcharov, Michael Papamichael, Adrian Caulfield, Todd Massengill, Ming Liu, Mahdi Ghandi, Daniel Lo, Steve Reinhardt, Shlomi Alkalay, Hari Angepat, Derek Chiou, Alessandro Forin, Doug Burger, Lisa Woods, Gabriel Weisz, Michael Haselman, Dan Zhang
IEEE Micro | March 2018, Vol 38: pp. 8-20
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18) | November 2017
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
Jason Li
October 2019
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul Bennett, Nick Craswell, Saurabh Tiwary
The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) | July 2019
Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, Emine Yilmaz
July 2019
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
Proceedings of the 42nd international ACM SIGIR conference on Research & development in information retrieval | April 2019
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Corby Rosset, Damien Jose, Gargi Ghosh, Bhaskar Mitra, Saurabh Tiwary
Proceedings of the 41st international ACM SIGIR conference on Research & development in information retrieval | May 2018
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18) | November 2017
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao
April 2020
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
May 2020
Eric Chung, Jeremy Fowers, Kalin Ovtcharov, Michael Papamichael, Adrian Caulfield, Todd Massengill, Ming Liu, Mahdi Ghandi, Daniel Lo, Steve Reinhardt, Shlomi Alkalay, Hari Angepat, Derek Chiou, Alessandro Forin, Doug Burger, Lisa Woods, Gabriel Weisz, Michael Haselman, Dan Zhang
IEEE Micro | March 2018, Vol 38: pp. 8-20
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
April 2021
Conglong Li, Ammar Ahmad Awan, Hanlin Tang, Samyam Rajbhandari, Yuxiong He
April 2021
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, Yuxiong He
May 2020
Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
April 2020
Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao
April 2020
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
February 2020
Jon Soifer, Minjia Zhang, Zehua Hu, Menghao Li, Jeffrey Zhu, Elton Zheng, Mingqin Li, Jason Li, Yuxiong He
December 2019
Jeffrey Zhu, Mingqin Li
November 2019
Jason Li
October 2019
Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
June 2018
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
2021 International Conference on Learning Representations | May 2021
Under review
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
Eighth International Conference on Learning Representations (ICLR) | April 2020
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
NeurIPS 2020 | February 2020
Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
AAAI | February 2020
Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
arXiv:1911.00536 | November 2019
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul Bennett, Nick Craswell, Saurabh Tiwary
The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) | July 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
ACL 2019 | June 2019
Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, Thomas Liu, Junhua Wang
2019 USENIX Conference on Operational Machine Learning (OpML ’19) | May 2019
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
Proceedings of the 42nd international ACM SIGIR conference on Research & development in information retrieval | April 2019
Corby Rosset, Damien Jose, Gargi Ghosh, Bhaskar Mitra, Saurabh Tiwary
Proceedings of the 41st international ACM SIGIR conference on Research & development in information retrieval | May 2018
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM’18) | November 2017
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Jianfeng Gao, Michel Galley, Lihong Li
Foundations and Trends in Information Retrieval | February 2019
Eric Chung, Jeremy Fowers, Kalin Ovtcharov, Michael Papamichael, Adrian Caulfield, Todd Massengill, Ming Liu, Mahdi Ghandi, Daniel Lo, Steve Reinhardt, Shlomi Alkalay, Hari Angepat, Derek Chiou, Alessandro Forin, Doug Burger, Lisa Woods, Gabriel Weisz, Michael Haselman, Dan Zhang
IEEE Micro | March 2018, Vol 38: pp. 8-20
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
November 2016
Bhaskar Mitra, Corby Rosset, David Hawking, Nick Craswell, Fernando Diaz, Emine Yilmaz
July 2019
Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
April 2019
Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
MSR-TR-2018-42 | December 2018
Publié par Microsoft