Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
Yu Fu, Zefan Cai, Abedelkadir Asi, Wayne Xiong, Yue Dong, Wen Xiao
ICLR 2025 | October 2024
Publications
Publications by Year
-
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | October 2024
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
-
Session-level Language Modeling for Conversational Speech
Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke
Proceedings EMNLP | November 2018
The Microsoft 2017 Conversational Speech Recognition System
Wayne Xiong, Lingfeng Wu, Jasha Droppo, Xuedong Huang, Andreas Stolcke
Proc. IEEE ICASSP | April 2018
Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
-
Toward Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2017, Vol 25: pp. 2410-2423
The Microsoft 2017 Conversational Speech Recognition System [Technical Report]
Wayne Xiong, Lingfeng Wu, Fil Alleva, Jasha Droppo, Xuedong Huang, Andreas Stolcke
MSR-TR-2017-39 | August 2017
The Microsoft 2016 Conversational Speech Recognition System
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
Proc. IEEE ICASSP | March 2017
Achieving Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
MSR-TR-2016-71 (revised) | February 2017
-
Achieving Human Parity in Conversational Speech Recognition
Geoff Zweig, Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu
December 2016
IEEE Spoken Language Technology Workshop
Invited talk, IEEE SLT Workshop
Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
Proc. Interspeech | September 2016
Publications by Research Area
-
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
Yu Fu, Zefan Cai, Abedelkadir Asi, Wayne Xiong, Yue Dong, Wen Xiao
ICLR 2025 | October 2024
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | October 2024
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
Session-level Language Modeling for Conversational Speech
Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke
Proceedings EMNLP | November 2018
The Microsoft 2017 Conversational Speech Recognition System
Wayne Xiong, Lingfeng Wu, Jasha Droppo, Xuedong Huang, Andreas Stolcke
Proc. IEEE ICASSP | April 2018
Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
Toward Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2017, Vol 25: pp. 2410-2423
The Microsoft 2017 Conversational Speech Recognition System [Technical Report]
Wayne Xiong, Lingfeng Wu, Fil Alleva, Jasha Droppo, Xuedong Huang, Andreas Stolcke
MSR-TR-2017-39 | August 2017
The Microsoft 2016 Conversational Speech Recognition System
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
Proc. IEEE ICASSP | March 2017
Achieving Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
MSR-TR-2016-71 (revised) | February 2017
Achieving Human Parity in Conversational Speech Recognition
Geoff Zweig, Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu
December 2016
IEEE Spoken Language Technology Workshop
Invited talk, IEEE SLT Workshop
Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
Proc. Interspeech | September 2016
Publications by Type
-
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
Yu Fu, Zefan Cai, Abedelkadir Asi, Wayne Xiong, Yue Dong, Wen Xiao
ICLR 2025 | October 2024
Integrative Decoding: Improve Factuality via Implicit Self-consistency
Yi Cheng, Xiao Liang, Yeyun Gong, Wen Xiao, Song Wang, Yuji Zhang, Wenjun Hou, Kaishuai Xu, Wenge Liu, Wenjie Li, Jian Jiao, Qi Chen, Peng Cheng, Wayne Xiong
ICLR 2025 | October 2024
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
Session-level Language Modeling for Conversational Speech
Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke
Proceedings EMNLP | November 2018
The Microsoft 2017 Conversational Speech Recognition System
Wayne Xiong, Lingfeng Wu, Jasha Droppo, Xuedong Huang, Andreas Stolcke
Proc. IEEE ICASSP | April 2018
The Microsoft 2016 Conversational Speech Recognition System
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
Proc. IEEE ICASSP | March 2017
Deep Convolutional Neural Networks with Layer-wise Context Expansion and Attention
Dong Yu, Wayne Xiong, Jasha Droppo, Andreas Stolcke, Guoli Ye, Jinyu Li, Geoffrey Zweig
Proc. Interspeech | September 2016
-
Progressive Joint Modeling in Unsupervised Single-channel Overlapped Speech Recognition
Zhehuai Chen, Jasha Droppo, Jinyu Li, Wayne Xiong
IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2018
Toward Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2017, Vol 25: pp. 2410-2423
-
The Microsoft 2017 Conversational Speech Recognition System [Technical Report]
Wayne Xiong, Lingfeng Wu, Fil Alleva, Jasha Droppo, Xuedong Huang, Andreas Stolcke
MSR-TR-2017-39 | August 2017
Achieving Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
MSR-TR-2016-71 (revised) | February 2017
-
Achieving Human Parity in Conversational Speech Recognition
Geoff Zweig, Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu
December 2016
IEEE Spoken Language Technology Workshop
Invited talk, IEEE SLT Workshop