Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
December 2023
Publications
Publications by Year
-
Multi Transcription-Style Speech Transcription Using Attention-based Encoder-decoder Model
Yan Huang, Piyush Behre, Guoli Ye, Shawn Chang, Yifan Gong
ASRU 2023 | December 2023
STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
Spoken Language Technology Workshop | January 2023
-
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
Endpoint Detection for Streaming End-to-End Multi-talker ASR
Liang Lu, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
-
On Addressing Practical Challenges For RNN-Transducer
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2021
Joint speaker diarisation and tracking in switching state-space model
Jeremy Wong, Yifan Gong
arXiv | September 2021
Diarisation using location tracking with agglomerative clustering
Jeremy Wong, Igor Abramovski, Xiong Xiao, Yifan Gong
arXiv | September 2021
Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
Interspeech 2021 | August 2021
Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
-
Speaker Separation Using Speaker Inventories and Estimated Speech
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
IEEE Transactions on Audio, Speech, and Language Processing | December 2020, Vol 29: pp. 537-546
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
Interspeech | October 2020
Combination of end-to-end and hybrid models for speech recognition
Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
Interspeech | October 2020
Exploring Transformers for Large-Scale Speech Recognition
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
Interspeech | October 2020
Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
Interspeech | October 2020
Acoustic Model Adaptation for Presentation Transcription and Intelligent Meeting Assistant Systems
ICASSP 2020 | May 2020
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
ICASSP | April 2020
Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
ICASSP | April 2020
L-Vector: Neural Label Embedding for Domain Adaptation
Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
ICASSP | April 2020
Minimum latency training strategies for streaming sequence-to-sequence ASR
Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
ICASSP | April 2020
Using personalized speech synthesis and neural language generator for rapid speaker adaptation
Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
ICASSP | April 2020
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
Character-aware attention-based end-to-end speech recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
CNN with phonetic attention for text-independent speaker verification
Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
Automatic Speech Recognition and Understanding Workshop | December 2019
Domain adaptation via teacher-student learning for end-to-end speech recognition
Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Improving RNN Transducer Modeling for End-to-End Speech Recognition
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Acoustic-to-Phrase Models for Speech Recognition
Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
Interspeech | September 2019
Layer Trajectory BLSTM
Eric Sun, Jinyu Li, Yifan Gong
Interspeech | September 2019
Speaker Adaptation for Attention-Based End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Interspeech | September 2019
Adversarial Speaker Adaptation
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Adversarial Speaker Verification
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | May 2019
Attentive Adversarial Learning for Domain-Invariant Training
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Conditional Teacher-Student Learning
Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
ICASSP | May 2019
Improving Layer Trajectory LSTM With Future Context Frames
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
ICASSP | May 2019
Towards Code-Switching ASR for End-to-End CTC Models
Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
ICASSP | May 2019
Universal Acoustic Modeling Using Neural Mixture Models
Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
ICASSP | May 2019
-
Exploring layer trajectory LSTM with depth processing units and attention
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
Spoken Language Technology | December 2018
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
Speaker Adaptation for End-to-End CTC Models
Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
Spoken Language Technology | December 2018
Adversarial Feature-Mapping for Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Cycle-Consistent Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Layer Trajectory LSTM
Jinyu Li, Changliang Liu, Yifan Gong
Interspeech 2018 | September 2018
Advancing Acoustic-to-Word CTC Model
Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
ICASSP | April 2018
Advancing Connectionist Temporal Classification With Attention Modeling
Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
ICASSP | April 2018
Developing Far-Field Speaker System Via Teacher-Student Learning
Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
ICASSP | April 2018
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
ICASSP | April 2018
Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
ICASSP | April 2018
Speaker-Invariant Training via Adversarial Learning
Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
-
Acoustic-To-Word Model Without OOV
Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
ASRU | December 2017
Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
ASRU | December 2017
Improving mask learning based speech enhancement system with restoration layers and residual connection
Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
Interspeech | August 2017
Large-Scale Domain Adaptation via Teacher-Student Learning
Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
Interspeech | August 2017
Don’t Count on ASR to Transcribe for You: Breaking Bias with Two Crowds
Michael Levit, Yan Huang, Shawn Chang, Yifan Gong
Interspeech | August 2017
Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
New Era for Robust Speech Recognitino: Exploiting Deep Learning | Published by Springer | 2017
Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
ICASSP | April 2017
Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
Jinyu Li, Yan Huang, Yifan Gong
ICASSP | April 2017
-
End-to-End Attention Based Text-Dependent Speaker Verification
Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
SLT workshop | December 2016
Semi-Supervised Training in Deep Learning Acoustic Model
Yan Huang, yongqiang wang, Yifan Gong
Interspeech 2016 | September 2016
Exploring Multidimensional LSTMs for Large Vocabulary ASR
Jinyu Li, Abdul Raheem Mohammad, Geoffrey Zweig, Yifan Gong
ICASSP | March 2016
ICASSP
Low-rank Plus Diagonal Adaption for Deep Neural Networks
Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
Recurrent Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
ICASSP | March 2016
ICASSP
-
LSTM Time and Frequency Recurrence for Automatic Speech Recognition
Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Compensation with Prior Knowledge
Jinyu Li, Li Deng, Yifan Gong
Robust Automatic Speech Recognition: A Bridge to Practical Applications | Published by Elsevier | 2015 | Robust Automatic Speech Recognition: A Bridge to Practical Applications edition
Regularized Sequence-Level Deep Neural Network Model Adaptation
Interspeech 2015 | September 2015
SVD-based Universal DNN Modeling for Multiple Scenarios
Changliang Liu, Jinyu Li, Yifan Gong
September 2015
An Analysis of Convolutional Neural Networks for Speech Recognition
Jui-Ting Huang, Jinyu Li, Yifan Gong
ICASSP | April 2015
Deep Neural Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Chaojun Liu, Kaisheng Yao, Yifan Gong
April 2015
Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
ICASSP | April 2015
ICASSP
Small-footprint high-performance deep neural network-based speech recognition using split-VQ
Yongqiang Wang, Jinyu Li, Yifan Gong
ICASSP | April 2015
-
variable-activation and variable-input deep neural network for robust speech recognition
IEEE SLT workshop | December 2014
Towards Better Performance with Heterogeneous Training Data in Acoustic Modeling using Deep Neural Networks
Yan Huang, Malcolm Slaney, Yifan Gong, Mike Seltzer
Proceedings of Interspeech 2014 | September 2014
A Comparative Analytic Study on the Gaussian Mixture and Context Dependent Deep Neural Network Hidden Markov Models
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
Learning Small-Size DNN with Output-Distribution-Based Criteria
Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
Interspeech | September 2014
Interspeech
Multi-Accent Deep Neural Network Acoustic Model with Accent-Specific Top Layer Using the KLD-Regularized Model Adaptation
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
Variable-Component Deep Neural Network for Robust Speech Recognition
Interspeech | September 2014
Interspeech
An Overview of Noise-Robust Automatic Speech Recognition
Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, Vol 22: pp. 745
Factorized adaptation for deep neural network
Jinyu Li, Jui-Ting Huang, Yifan Gong
ICASSP | January 2014
Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
ICASSP | January 2014
-
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong
August 2013
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong, Chaojun Liu
Interspeech 2013 | August 2013
Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Predicting speech recognition confidence using deep learning with word identity and score features
Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng
Proc. ICASSP | May 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
A fast maximum likelihood nonlinear feature transformation method for GMM-HMM speaker adaptation
Kaisheng Yao, Dong Yu, Li Deng, Yifan Gong
Neurocomputing | January 2013
Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
Jian Xue, Jinyu Li, Yifan Gong
Interspeech | January 2013
-
Adaptation Of Context-Dependent Deep Neural Networks For Automatic Speech Recognition
Kaisheng Yao, Dong Yu, Frank Seide, Hang Su, Li Deng, Yifan Gong
SLT 2012 | December 2012
SLT 2012
-
Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
ICML Workshop 2011 | June 2011
-
Unscented Transform with Online Distortion Estimation for HMM Adaptation
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
Interspeech 2010 | September 2010
-
A Novel Framework and Training Algorithm for Variable-Parameter Hidden Markov Models
Dong Yu, Li Deng, Yifan Gong, Alex Acero
IEEE Transactions on Audio, Speech and Language Processing | September 2009, Vol 17(7): pp. 1348-1360
A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR
Hui Lin, Li Deng, Chi-Hui Lee, Dong Yu, Alex Acero, Yifan Gong
Proceedings of the ICASSP | April 2009
Cross-lingual speech recognition under run-time resource constraints
Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero
Proceedings of the ICASSP | April 2009
A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Computer Speech and Language | January 2009, Vol 23: pp. 389-405
-
Improvements on Mel-Frequency Cepstrum Minimum-Mean-Square-Error Noise Suppressor for Robust Speech Recognition
Dong Yu, Li Deng, Jian Wu, Yifan Gong, Alex Acero
ISCSLP | December 2008
Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition
Li Deng, Yifan Gong, Alex Acero, Dong Yu
Proceedings of the Interspeech | September 2008
Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition
Dong Yu, Li Deng, Yifan Gong, Alex Acero
Proc. of the Interspeech | September 2008
Robust speech recognition using cepstral minimum-mean-square-error noise suppressor
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, Ivan Tashev, Mike Seltzer
IEEE Trans. Audio, Speech, and Language Processing | July 2008, Vol 16(5)
A Minimum Mean-Square-Error Noise Reduction Algorithm on Mel-Frequency Cepstra for Robust Speech Recognition
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero
Proc. ICASSP | April 2008
Proc. ICASSP
Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
April 2008
HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
April 2008
-
High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Proceedings IEEE Workshop on ASRU | April 2007
Proceedings IEEE Workshop on ASRU
Publications by Research Area
-
Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
December 2023
Multi Transcription-Style Speech Transcription Using Attention-based Encoder-decoder Model
Yan Huang, Piyush Behre, Guoli Ye, Shawn Chang, Yifan Gong
ASRU 2023 | December 2023
STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
Spoken Language Technology Workshop | January 2023
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
On Addressing Practical Challenges For RNN-Transducer
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2021
Joint speaker diarisation and tracking in switching state-space model
Jeremy Wong, Yifan Gong
arXiv | September 2021
Diarisation using location tracking with agglomerative clustering
Jeremy Wong, Igor Abramovski, Xiong Xiao, Yifan Gong
arXiv | September 2021
Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
Interspeech 2021 | August 2021
Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Speaker Separation Using Speaker Inventories and Estimated Speech
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
IEEE Transactions on Audio, Speech, and Language Processing | December 2020, Vol 29: pp. 537-546
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
Interspeech | October 2020
Exploring Transformers for Large-Scale Speech Recognition
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
Interspeech | October 2020
Combination of end-to-end and hybrid models for speech recognition
Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
Interspeech | October 2020
Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
Interspeech | October 2020
Acoustic Model Adaptation for Presentation Transcription and Intelligent Meeting Assistant Systems
ICASSP 2020 | May 2020
Minimum latency training strategies for streaming sequence-to-sequence ASR
Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
ICASSP | April 2020
Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
ICASSP | April 2020
Using personalized speech synthesis and neural language generator for rapid speaker adaptation
Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
ICASSP | April 2020
L-Vector: Neural Label Embedding for Domain Adaptation
Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
ICASSP | April 2020
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
CNN with phonetic attention for text-independent speaker verification
Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
Automatic Speech Recognition and Understanding Workshop | December 2019
Character-aware attention-based end-to-end speech recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Domain adaptation via teacher-student learning for end-to-end speech recognition
Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Improving RNN Transducer Modeling for End-to-End Speech Recognition
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
Speaker Adaptation for Attention-Based End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Interspeech | September 2019
Acoustic-to-Phrase Models for Speech Recognition
Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
Interspeech | September 2019
Layer Trajectory BLSTM
Eric Sun, Jinyu Li, Yifan Gong
Interspeech | September 2019
Improving Layer Trajectory LSTM With Future Context Frames
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
ICASSP | May 2019
Adversarial Speaker Verification
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | May 2019
Adversarial Speaker Adaptation
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Towards Code-Switching ASR for End-to-End CTC Models
Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
ICASSP | May 2019
Attentive Adversarial Learning for Domain-Invariant Training
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Conditional Teacher-Student Learning
Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
ICASSP | May 2019
Universal Acoustic Modeling Using Neural Mixture Models
Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
ICASSP | May 2019
Exploring layer trajectory LSTM with depth processing units and attention
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
Spoken Language Technology | December 2018
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
Speaker Adaptation for End-to-End CTC Models
Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
Spoken Language Technology | December 2018
Adversarial Feature-Mapping for Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Cycle-Consistent Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Layer Trajectory LSTM
Jinyu Li, Changliang Liu, Yifan Gong
Interspeech 2018 | September 2018
Advancing Connectionist Temporal Classification With Attention Modeling
Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
ICASSP | April 2018
Advancing Acoustic-to-Word CTC Model
Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
ICASSP | April 2018
Developing Far-Field Speaker System Via Teacher-Student Learning
Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
ICASSP | April 2018
DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
ICASSP | April 2018
Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
ICASSP | April 2018
Speaker-Invariant Training via Adversarial Learning
Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
Acoustic-To-Word Model Without OOV
Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
ASRU | December 2017
Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
ASRU | December 2017
Improving mask learning based speech enhancement system with restoration layers and residual connection
Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
Interspeech | August 2017
Large-Scale Domain Adaptation via Teacher-Student Learning
Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
Interspeech | August 2017
Don’t Count on ASR to Transcribe for You: Breaking Bias with Two Crowds
Michael Levit, Yan Huang, Shawn Chang, Yifan Gong
Interspeech | August 2017
Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
New Era for Robust Speech Recognitino: Exploiting Deep Learning | Published by Springer | 2017
Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
ICASSP | April 2017
Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
Jinyu Li, Yan Huang, Yifan Gong
ICASSP | April 2017
End-to-End Attention Based Text-Dependent Speaker Verification
Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
SLT workshop | December 2016
Semi-Supervised Training in Deep Learning Acoustic Model
Yan Huang, yongqiang wang, Yifan Gong
Interspeech 2016 | September 2016
Recurrent Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
Compensation with Prior Knowledge
Jinyu Li, Li Deng, Yifan Gong
Robust Automatic Speech Recognition: A Bridge to Practical Applications | Published by Elsevier | 2015 | Robust Automatic Speech Recognition: A Bridge to Practical Applications edition
Regularized Sequence-Level Deep Neural Network Model Adaptation
Interspeech 2015 | September 2015
Small-footprint high-performance deep neural network-based speech recognition using split-VQ
Yongqiang Wang, Jinyu Li, Yifan Gong
ICASSP | April 2015
An Analysis of Convolutional Neural Networks for Speech Recognition
Jui-Ting Huang, Jinyu Li, Yifan Gong
ICASSP | April 2015
Multi-Accent Deep Neural Network Acoustic Model with Accent-Specific Top Layer Using the KLD-Regularized Model Adaptation
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
An Overview of Noise-Robust Automatic Speech Recognition
Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, Vol 22: pp. 745
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong
August 2013
Predicting speech recognition confidence using deep learning with word identity and score features
Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng
Proc. ICASSP | May 2013
Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
Jian Xue, Jinyu Li, Yifan Gong
Interspeech | January 2013
Adaptation Of Context-Dependent Deep Neural Networks For Automatic Speech Recognition
Kaisheng Yao, Dong Yu, Frank Seide, Hang Su, Li Deng, Yifan Gong
SLT 2012 | December 2012
SLT 2012
A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR
Hui Lin, Li Deng, Chi-Hui Lee, Dong Yu, Alex Acero, Yifan Gong
Proceedings of the ICASSP | April 2009
Cross-lingual speech recognition under run-time resource constraints
Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero
Proceedings of the ICASSP | April 2009
A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Computer Speech and Language | January 2009, Vol 23: pp. 389-405
Improvements on Mel-Frequency Cepstrum Minimum-Mean-Square-Error Noise Suppressor for Robust Speech Recognition
Dong Yu, Li Deng, Jian Wu, Yifan Gong, Alex Acero
ISCSLP | December 2008
Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition
Li Deng, Yifan Gong, Alex Acero, Dong Yu
Proceedings of the Interspeech | September 2008
Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition
Dong Yu, Li Deng, Yifan Gong, Alex Acero
Proc. of the Interspeech | September 2008
Robust speech recognition using cepstral minimum-mean-square-error noise suppressor
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, Ivan Tashev, Mike Seltzer
IEEE Trans. Audio, Speech, and Language Processing | July 2008, Vol 16(5)
High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Proceedings IEEE Workshop on ASRU | April 2007
Proceedings IEEE Workshop on ASRU
-
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
Endpoint Detection for Streaming End-to-End Multi-talker ASR
Liang Lu, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
Joint speaker diarisation and tracking in switching state-space model
Jeremy Wong, Yifan Gong
arXiv | September 2021
Diarisation using location tracking with agglomerative clustering
Jeremy Wong, Igor Abramovski, Xiong Xiao, Yifan Gong
arXiv | September 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Speaker Separation Using Speaker Inventories and Estimated Speech
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
IEEE Transactions on Audio, Speech, and Language Processing | December 2020, Vol 29: pp. 537-546
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
-
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
Joint speaker diarisation and tracking in switching state-space model
Jeremy Wong, Yifan Gong
arXiv | September 2021
Diarisation using location tracking with agglomerative clustering
Jeremy Wong, Igor Abramovski, Xiong Xiao, Yifan Gong
arXiv | September 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Speaker Separation Using Speaker Inventories and Estimated Speech
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
IEEE Transactions on Audio, Speech, and Language Processing | December 2020, Vol 29: pp. 537-546
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
Small-footprint high-performance deep neural network-based speech recognition using split-VQ
Yongqiang Wang, Jinyu Li, Yifan Gong
ICASSP | April 2015
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong
August 2013
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong, Chaojun Liu
Interspeech 2013 | August 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR
Hui Lin, Li Deng, Chi-Hui Lee, Dong Yu, Alex Acero, Yifan Gong
Proceedings of the ICASSP | April 2009
Cross-lingual speech recognition under run-time resource constraints
Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero
Proceedings of the ICASSP | April 2009
Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition
Li Deng, Yifan Gong, Alex Acero, Dong Yu
Proceedings of the Interspeech | September 2008
Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition
Dong Yu, Li Deng, Yifan Gong, Alex Acero
Proc. of the Interspeech | September 2008
Robust speech recognition using cepstral minimum-mean-square-error noise suppressor
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, Ivan Tashev, Mike Seltzer
IEEE Trans. Audio, Speech, and Language Processing | July 2008, Vol 16(5)
Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
April 2008
A Minimum Mean-Square-Error Noise Reduction Algorithm on Mel-Frequency Cepstra for Robust Speech Recognition
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero
Proc. ICASSP | April 2008
Proc. ICASSP
HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
April 2008
-
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
ICASSP | April 2020
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong, Chaojun Liu
Interspeech 2013 | August 2013
Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
ICML Workshop 2011 | June 2011
Unscented Transform with Online Distortion Estimation for HMM Adaptation
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
Interspeech 2010 | September 2010
A Novel Framework and Training Algorithm for Variable-Parameter Hidden Markov Models
Dong Yu, Li Deng, Yifan Gong, Alex Acero
IEEE Transactions on Audio, Speech and Language Processing | September 2009, Vol 17(7): pp. 1348-1360
A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR
Hui Lin, Li Deng, Chi-Hui Lee, Dong Yu, Alex Acero, Yifan Gong
Proceedings of the ICASSP | April 2009
Cross-lingual speech recognition under run-time resource constraints
Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero
Proceedings of the ICASSP | April 2009
A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Computer Speech and Language | January 2009, Vol 23: pp. 389-405
Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition
Li Deng, Yifan Gong, Alex Acero, Dong Yu
Proceedings of the Interspeech | September 2008
Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition
Dong Yu, Li Deng, Yifan Gong, Alex Acero
Proc. of the Interspeech | September 2008
Robust speech recognition using cepstral minimum-mean-square-error noise suppressor
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, Ivan Tashev, Mike Seltzer
IEEE Trans. Audio, Speech, and Language Processing | July 2008, Vol 16(5)
Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
April 2008
A Minimum Mean-Square-Error Noise Reduction Algorithm on Mel-Frequency Cepstra for Robust Speech Recognition
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero
Proc. ICASSP | April 2008
Proc. ICASSP
HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
April 2008
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
LSTM Time and Frequency Recurrence for Automatic Speech Recognition
Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
ICASSP | January 2014
-
Exploring Multidimensional LSTMs for Large Vocabulary ASR
Jinyu Li, Abdul Raheem Mohammad, Geoffrey Zweig, Yifan Gong
ICASSP | March 2016
ICASSP
Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
ICASSP | April 2015
ICASSP
-
Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
ICASSP | March 2016
ICASSP
Low-rank Plus Diagonal Adaption for Deep Neural Networks
Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
Deep Neural Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Chaojun Liu, Kaisheng Yao, Yifan Gong
April 2015
A Comparative Analytic Study on the Gaussian Mixture and Context Dependent Deep Neural Network Hidden Markov Models
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
Learning Small-Size DNN with Output-Distribution-Based Criteria
Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
Interspeech | September 2014
Interspeech
Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
-
Compensation with Prior Knowledge
Jinyu Li, Li Deng, Yifan Gong
Robust Automatic Speech Recognition: A Bridge to Practical Applications | Published by Elsevier | 2015 | Robust Automatic Speech Recognition: A Bridge to Practical Applications edition
SVD-based Universal DNN Modeling for Multiple Scenarios
Changliang Liu, Jinyu Li, Yifan Gong
September 2015
-
variable-activation and variable-input deep neural network for robust speech recognition
IEEE SLT workshop | December 2014
Towards Better Performance with Heterogeneous Training Data in Acoustic Modeling using Deep Neural Networks
Yan Huang, Malcolm Slaney, Yifan Gong, Mike Seltzer
Proceedings of Interspeech 2014 | September 2014
Variable-Component Deep Neural Network for Robust Speech Recognition
Interspeech | September 2014
Interspeech
-
Factorized adaptation for deep neural network
Jinyu Li, Jui-Ting Huang, Yifan Gong
ICASSP | January 2014
A fast maximum likelihood nonlinear feature transformation method for GMM-HMM speaker adaptation
Kaisheng Yao, Dong Yu, Li Deng, Yifan Gong
Neurocomputing | January 2013
Publications by Type
-
Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong
December 2023
Multi Transcription-Style Speech Transcription Using Attention-based Encoder-decoder Model
Yan Huang, Piyush Behre, Guoli Ye, Shawn Chang, Yifan Gong
ASRU 2023 | December 2023
STREAMING, FAST AND ACCURATE ON-DEVICE INVERSE TEXT NORMALIZATION FOR AUTOMATIC SPEECH RECOGNITION
Yashesh Gaur, Nick Kibre, Jian Xue, Kangyuan Shu, Yuhui Wang, Issac Alphanso, Jinyu Li, Yifan Gong
Spoken Language Technology Workshop | January 2023
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
Have best of both worlds: two-pass hybrid and E2E cascading framework for speech recognition
Guoli Ye, Vadim Mazalov, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
Endpoint Detection for Streaming End-to-End Multi-talker ASR
Liang Lu, Jinyu Li, Yifan Gong
ICASSP 2022 | May 2022
On Addressing Practical Challenges For RNN-Transducer
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2021
Joint speaker diarisation and tracking in switching state-space model
Jeremy Wong, Yifan Gong
arXiv | September 2021
Diarisation using location tracking with agglomerative clustering
Jeremy Wong, Igor Abramovski, Xiong Xiao, Yifan Gong
arXiv | September 2021
Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias are All You Need
Yan Huang, Guoli Ye, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Multiple Softmax Architecture for Streaming Multilingual End-to-End ASR Systems
Vikas Joshi, Amit Das, Eric Sun, Rupesh Mehta, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS
Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He
Interspeech 2021 | August 2021
Improving Multilingual Transformer Transducer Models by Reducing Language Confusions
Eric Sun, Jinyu Li, Zhong Meng, Yu Wu, Jian Xue, Shujie Liu, Yifan Gong
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Hidden Markov model diarisation with speaker location information
Jeremy Wong, Xiong Xiao, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Ensemble Combination between Different Time Segmentations
Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong
2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong
Interspeech | October 2020
Exploring Transformers for Large-Scale Speech Recognition
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
Interspeech | October 2020
Combination of end-to-end and hybrid models for speech recognition
Jeremy Wong, Yashesh Gaur, Rui Zhao, Liang Lu, Eric Sun, Jinyu Li, Yifan Gong
Interspeech | October 2020
Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator
Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong
Interspeech | October 2020
Acoustic Model Adaptation for Presentation Transcription and Intelligent Meeting Assistant Systems
ICASSP 2020 | May 2020
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
Jinyu Li, Rui Zhao, Eric Sun, Jeremy Wong, Amit Das, Zhong Meng, Yifan Gong
ICASSP | April 2020
Minimum latency training strategies for streaming sequence-to-sequence ASR
Hirofumi Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li, Yifan Gong
ICASSP | April 2020
Exploring pre-training with alignments for RNN transducer based end-to-end speech recognition
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu, Yifan Gong
ICASSP | April 2020
Using personalized speech synthesis and neural language generator for rapid speaker adaptation
Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong
ICASSP | April 2020
L-Vector: Neural Label Embedding for Domain Adaptation
Zhong Meng, Hu Hu, Jinyu Li, Changliang Liu, Yan Huang, Yifan Gong, Chin-Hui Lee
ICASSP | April 2020
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
CNN with phonetic attention for text-independent speaker verification
Tianyan Zhou, yong zhao, Jinyu Li, Yifan Gong, Jian Wu
Automatic Speech Recognition and Understanding Workshop | December 2019
Character-aware attention-based end-to-end speech recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Domain adaptation via teacher-student learning for end-to-end speech recognition
Zhong Meng, Jinyu Li, Yashesh Gaur, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Improving RNN Transducer Modeling for End-to-End Speech Recognition
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
Automatic Speech Recognition and Understanding Workshop | December 2019
Speaker Adaptation for Attention-Based End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Jinyu Li, Yifan Gong
Interspeech | September 2019
Acoustic-to-Phrase Models for Speech Recognition
Yashesh Gaur, Jinyu Li, Zhong Meng, Yifan Gong
Interspeech | September 2019
Layer Trajectory BLSTM
Eric Sun, Jinyu Li, Yifan Gong
Interspeech | September 2019
Improving Layer Trajectory LSTM With Future Context Frames
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
ICASSP | May 2019
Adversarial Speaker Verification
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | May 2019
Adversarial Speaker Adaptation
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Towards Code-Switching ASR for End-to-End CTC Models
Ke Li, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
ICASSP | May 2019
Attentive Adversarial Learning for Domain-Invariant Training
Zhong Meng, Jinyu Li, Yifan Gong
ICASSP | May 2019
Conditional Teacher-Student Learning
Zhong Meng, Jinyu Li, Yong Zhao, Yifan Gong
ICASSP | May 2019
Universal Acoustic Modeling Using Neural Mixture Models
Amit Das, Jinyu Li, Changliang Liu, Yifan Gong
ICASSP | May 2019
Exploring layer trajectory LSTM with depth processing units and attention
Jinyu Li, Liang Lu, Changliang Liu, Yifan Gong
Spoken Language Technology | December 2018
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
Speaker Adaptation for End-to-End CTC Models
Ke Li, Jinyu Li, yong zhao, Yifan Gong (ygong), Kshitiz Kumar
Spoken Language Technology | December 2018
Adversarial Feature-Mapping for Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Cycle-Consistent Speech Enhancement
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang Juang
Interspeech 2018 | September 2018
Layer Trajectory LSTM
Jinyu Li, Changliang Liu, Yifan Gong
Interspeech 2018 | September 2018
Advancing Connectionist Temporal Classification With Attention Modeling
Amit Das, Jinyu Li, Rui Zhao, Yifan Gong
ICASSP | April 2018
Advancing Acoustic-to-Word CTC Model
Jinyu Li, Guoli Ye, Amit Das, Rui Zhao, Yifan Gong
ICASSP | April 2018
Developing Far-Field Speaker System Via Teacher-Student Learning
Jinyu Li, Rui Zhao, Zhuo Chen, Changliang Liu, Xiong Xiao, Guoli Ye, Yifan Gong
ICASSP | April 2018
DOMAIN AND SPEAKER ADAPTATION FOR CORTANA SPEECH RECOGNITION
Yong Zhao, Jinyu Li, Shixiong Zhang, Liping Chen, Yifan Gong
ICASSP | April 2018
Efficient integration of fixed beamformers and speech separation networks for multi-channel far-field speech separation
Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
ICASSP | April 2018
Speaker-Invariant Training via Adversarial Learning
Zhong Meng, Jinyu Li, Zhuo Chen, Yong Zhao, Vadim Mazalov, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
Adversarial Teacher-Student Learning for Unsupervised Domain Adaptation
Zhong Meng, Jinyu Li, Yifan Gong, Biing-Hwang (Fred) Juang
ICASSP | April 2018
Acoustic-To-Word Model Without OOV
Jinyu Li, Guoli Ye, Rui Zhao, Jasha Droppo, Yifan Gong
ASRU | December 2017
Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition
Zhong Meng, Zhuo Chen, Vadim Mazalov, Jinyu Li, Yifan Gong
ASRU | December 2017
Improving mask learning based speech enhancement system with restoration layers and residual connection
Zhuo Chen, Yan Huang, Jinyu Li, Yifan Gong
Interspeech | August 2017
Large-Scale Domain Adaptation via Teacher-Student Learning
Jinyu Li, Michael Seltzer, Xi Wang, Rui Zhao, Yifan Gong
Interspeech | August 2017
Extended low-rank plus diagonal adaptation for deep and recurrent neural networks
yong zhao, Jinyu Li, kshitiz kumar, Yifan Gong
ICASSP | April 2017
Improved Cepstra Minimum-Mean-Square-Error Noise Reduction Algorithm For Robust Speech Recognition
Jinyu Li, Yan Huang, Yifan Gong
ICASSP | April 2017
End-to-End Attention Based Text-Dependent Speaker Verification
Shixiong Zhang, Zhuo Chen, Yong Zhao, Jinyu Li, Yifan Gong
SLT workshop | December 2016
Semi-Supervised Training in Deep Learning Acoustic Model
Yan Huang, yongqiang wang, Yifan Gong
Interspeech 2016 | September 2016
Exploring Multidimensional LSTMs for Large Vocabulary ASR
Jinyu Li, Abdul Raheem Mohammad, Geoffrey Zweig, Yifan Gong
ICASSP | March 2016
ICASSP
Simplifying Long Short-term Memory Acoustic Models for Fast Training and Decoding
Yajie Miao, Jinyu Li, Yongqiang Wang, Shi-Xiong Zhang, Yifan Gong
ICASSP | March 2016
ICASSP
Recurrent Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Rui Zhao, Chaojun Liu, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
Low-rank Plus Diagonal Adaption for Deep Neural Networks
Yong Zhao, Jinyu Li, Yifan Gong
ICASSP | March 2016
ICASSP
LSTM Time and Frequency Recurrence for Automatic Speech Recognition
Jinyu Li, Abdelrahman Mohamed, Geoffrey Zweig, Yifan Gong
IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Regularized Sequence-Level Deep Neural Network Model Adaptation
Interspeech 2015 | September 2015
SVD-based Universal DNN Modeling for Multiple Scenarios
Changliang Liu, Jinyu Li, Yifan Gong
September 2015
Small-footprint high-performance deep neural network-based speech recognition using split-VQ
Yongqiang Wang, Jinyu Li, Yifan Gong
ICASSP | April 2015
Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data
Yong Zhao, Jinyu Li, Jian Xue, Yifan Gong
ICASSP | April 2015
ICASSP
An Analysis of Convolutional Neural Networks for Speech Recognition
Jui-Ting Huang, Jinyu Li, Yifan Gong
ICASSP | April 2015
Deep Neural Support Vector Machines for Speech Recognition
Shi-Xiong Zhang, Chaojun Liu, Kaisheng Yao, Yifan Gong
April 2015
variable-activation and variable-input deep neural network for robust speech recognition
IEEE SLT workshop | December 2014
Towards Better Performance with Heterogeneous Training Data in Acoustic Modeling using Deep Neural Networks
Yan Huang, Malcolm Slaney, Yifan Gong, Mike Seltzer
Proceedings of Interspeech 2014 | September 2014
Multi-Accent Deep Neural Network Acoustic Model with Accent-Specific Top Layer Using the KLD-Regularized Model Adaptation
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
A Comparative Analytic Study on the Gaussian Mixture and Context Dependent Deep Neural Network Hidden Markov Models
Yan Huang, Dong Yu, Chaojun Liu, Yifan Gong
Interspeech 2014 | September 2014
Interspeech 2014
Learning Small-Size DNN with Output-Distribution-Based Criteria
Jinyu Li, Rui Zhao, Jui-Ting Huang, Yifan Gong
Interspeech | September 2014
Interspeech
Variable-Component Deep Neural Network for Robust Speech Recognition
Interspeech | September 2014
Interspeech
Singular Value Decomposition Based Low-footprint Speaker Adaptation and Personalization for Deep Neural Network
Jian Xue, Jinyu Li, Dong Yu, Mike Seltzer, Yifan Gong
ICASSP | January 2014
Factorized adaptation for deep neural network
Jinyu Li, Jui-Ting Huang, Yifan Gong
ICASSP | January 2014
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong
August 2013
Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
Yan Huang, Dong Yu, Yifan Gong, Chaojun Liu
Interspeech 2013 | August 2013
Recent Advances in Deep Learning for Speech Research at Microsoft
Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero
May 2013
Cross-language Knowledge Transfer using Multilingual Deep Neural Network with Shared Hidden Layers
Jui-Ting Huang, Jinyu Li, Dong Yu, Li Deng, Yifan Gong
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
Predicting speech recognition confidence using deep learning with word identity and score features
Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng
Proc. ICASSP | May 2013
Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition
Jian Xue, Jinyu Li, Yifan Gong
Interspeech | January 2013
Adaptation Of Context-Dependent Deep Neural Networks For Automatic Speech Recognition
Kaisheng Yao, Dong Yu, Frank Seide, Hang Su, Li Deng, Yifan Gong
SLT 2012 | December 2012
SLT 2012
Towards High-Accuracy Low-Cost Noisy Robust Speech Recognition Exploiting Structured Model
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
ICML Workshop 2011 | June 2011
Unscented Transform with Online Distortion Estimation for HMM Adaptation
Jinyu Li, Dong Yu, Li Deng, Yifan Gong
Interspeech 2010 | September 2010
A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR
Hui Lin, Li Deng, Chi-Hui Lee, Dong Yu, Alex Acero, Yifan Gong
Proceedings of the ICASSP | April 2009
Cross-lingual speech recognition under run-time resource constraints
Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero
Proceedings of the ICASSP | April 2009
Improvements on Mel-Frequency Cepstrum Minimum-Mean-Square-Error Noise Suppressor for Robust Speech Recognition
Dong Yu, Li Deng, Jian Wu, Yifan Gong, Alex Acero
ISCSLP | December 2008
Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition
Li Deng, Yifan Gong, Alex Acero, Dong Yu
Proceedings of the Interspeech | September 2008
Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition
Dong Yu, Li Deng, Yifan Gong, Alex Acero
Proc. of the Interspeech | September 2008
Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero
April 2008
A Minimum Mean-Square-Error Noise Reduction Algorithm on Mel-Frequency Cepstra for Robust Speech Recognition
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero
Proc. ICASSP | April 2008
Proc. ICASSP
HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model for Environment-Robust Speech Recognition
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
April 2008
High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Proceedings IEEE Workshop on ASRU | April 2007
Proceedings IEEE Workshop on ASRU
-
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
Speaker Separation Using Speaker Inventories and Estimated Speech
Peidong Wang, Zhuo Chen, DeLiang Wang, Jinyu Li, Yifan Gong
IEEE Transactions on Audio, Speech, and Language Processing | December 2020, Vol 29: pp. 537-546
Advancing Acoustic-to-Word CTC Model with Attention and Mixed-Units
Amit Das, Jinyu Li, Guoli Ye, Rui Zhao, Yifan Gong
IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING | December 2019, pp. 1880-1892
Don’t Count on ASR to Transcribe for You: Breaking Bias with Two Crowds
Michael Levit, Yan Huang, Shawn Chang, Yifan Gong
Interspeech | August 2017
An Overview of Noise-Robust Automatic Speech Recognition
Jinyu Li, Li Deng, Yifan Gong, Reinhold Haeb-Umbach
IEEE/ACM Transactions on Audio, Speech, and Language Processing | April 2014, Vol 22: pp. 745
A fast maximum likelihood nonlinear feature transformation method for GMM-HMM speaker adaptation
Kaisheng Yao, Dong Yu, Li Deng, Yifan Gong
Neurocomputing | January 2013
A Novel Framework and Training Algorithm for Variable-Parameter Hidden Markov Models
Dong Yu, Li Deng, Yifan Gong, Alex Acero
IEEE Transactions on Audio, Speech and Language Processing | September 2009, Vol 17(7): pp. 1348-1360
A unified framework of HMM adaptation with joint compensation of additive and convolutive distortions
Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero
Computer Speech and Language | January 2009, Vol 23: pp. 389-405
Robust speech recognition using cepstral minimum-mean-square-error noise suppressor
Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, Ivan Tashev, Mike Seltzer
IEEE Trans. Audio, Speech, and Language Processing | July 2008, Vol 16(5)
-
Challenges and Solutions to Deep Learning Network Acoustic Modeling in Speech Recognition Products at Microsoft
New Era for Robust Speech Recognitino: Exploiting Deep Learning | Published by Springer | 2017
Compensation with Prior Knowledge
Jinyu Li, Li Deng, Yifan Gong
Robust Automatic Speech Recognition: A Bridge to Practical Applications | Published by Elsevier | 2015 | Robust Automatic Speech Recognition: A Bridge to Practical Applications edition