Sefik Emre Eskimez

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

Knowledge boosting during low-latency inference

Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Target conversation extraction: Source separation using turn-taking dynamics

Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka

August 2023

Publication

Real-Time Audio-Visual End-To-End Speech Enhancement

Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang

2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication

Speech separation with large-scale self-supervised learning

Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez

arXiv:2211.05172 | November 2022

Publication

Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka

November 2022

Submitted to ICASSP 2023

Publication

Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net

Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang

November 2022

Submitted to ICASSP 2023

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation

Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang

Interspeech 2022 | September 2022

Publication

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka

INTERSPEECH 2022 | September 2022

Publication

One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

All-Neural Beamformer for Continuous Speech Separation

Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez

ICASSP 2022 | May 2022

Publication Project

ICASSP 2022 Deep Noise Suppression Challenge

Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner

ICASSP | May 2022

Publication Project

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka

Interspeech 2021 | August 2021

Preprint Project

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI Project

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication Project

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

End-To-End Generation of Talking Faces from Noisy Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Noise-Resilient Training Method for Face Landmark Generation From Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38

Publication

Speech Super Resolution Generative Adversarial Network

Sefik Emre Eskimez, Kazuhito Koishida

ICASSP 2019 | May 2019

DOI Publication

Adversarial Training for Speech Super-Resolution

Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan

IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358

DOI Publication

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition

Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman

2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018

Publication

Generating Talking Face Landmarks from Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

LVA/ICA 2018 | June 2018

Publication

Front-end speech enhancement for commercial speaker verification systems

Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman

Speech Communication | May 2018, Vol 99: pp. 101-113

Publication

WISE: Web-based Interactive Speech Emotion Classification

Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

International Joint Conferences on Artificial Intelligence | July 2016

Publication

Emotion classification: How does an automated system compare to Naive human coders?

Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016

Publication

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka

August 2023

Publication

Speech separation with large-scale self-supervised learning

Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez

arXiv:2211.05172 | November 2022

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka

INTERSPEECH 2022 | September 2022

Publication

All-Neural Beamformer for Continuous Speech Separation

Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez

ICASSP 2022 | May 2022

Publication Project

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Target conversation extraction: Source separation using turn-taking dynamics

Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Knowledge boosting during low-latency inference

Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka

August 2023

Publication

Speech separation with large-scale self-supervised learning

Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez

arXiv:2211.05172 | November 2022

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka

Interspeech 2021 | August 2021

Preprint Project

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI Project

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication Project

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication Project

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

End-To-End Generation of Talking Faces from Noisy Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Noise-Resilient Training Method for Face Landmark Generation From Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38

Publication

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition

Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman

2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018

Publication

Generating Talking Face Landmarks from Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

LVA/ICA 2018 | June 2018

Publication

Front-end speech enhancement for commercial speaker verification systems

Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman

Speech Communication | May 2018, Vol 99: pp. 101-113

Publication

WISE: Web-based Interactive Speech Emotion Classification

Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

International Joint Conferences on Artificial Intelligence | July 2016

Publication

Emotion classification: How does an automated system compare to Naive human coders?

Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016

Publication

Target conversation extraction: Source separation using turn-taking dynamics

Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Knowledge boosting during low-latency inference

Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka

August 2023

Publication

Real-Time Audio-Visual End-To-End Speech Enhancement

Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang

2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication

Speech separation with large-scale self-supervised learning

Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez

arXiv:2211.05172 | November 2022

Publication

Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka

November 2022

Submitted to ICASSP 2023

Publication

Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net

Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang

November 2022

Submitted to ICASSP 2023

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation

Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang

Interspeech 2022 | September 2022

Publication

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka

INTERSPEECH 2022 | September 2022

Publication

One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

ICASSP 2022 Deep Noise Suppression Challenge

Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner

ICASSP | May 2022

Publication Project

All-Neural Beamformer for Continuous Speech Separation

Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez

ICASSP 2022 | May 2022

Publication Project

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka

Interspeech 2021 | August 2021

Preprint Project

End-To-End Generation of Talking Faces from Noisy Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Noise-Resilient Training Method for Face Landmark Generation From Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38

Publication

Speech Super Resolution Generative Adversarial Network

Sefik Emre Eskimez, Kazuhito Koishida

ICASSP 2019 | May 2019

DOI Publication

Adversarial Training for Speech Super-Resolution

Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan

IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358

DOI Publication

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition

Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman

2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018

Publication

Generating Talking Face Landmarks from Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

LVA/ICA 2018 | June 2018

Publication

Front-end speech enhancement for commercial speaker verification systems

Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman

Speech Communication | May 2018, Vol 99: pp. 101-113

Publication

WISE: Web-based Interactive Speech Emotion Classification

Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

International Joint Conferences on Artificial Intelligence | July 2016

Publication

Emotion classification: How does an automated system compare to Naive human coders?

Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016

Publication

Real-Time Audio-Visual End-To-End Speech Enhancement

Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang

2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication

End-To-End Generation of Talking Faces from Noisy Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020

Publication

Noise-Resilient Training Method for Face Landmark Generation From Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38

Publication

Generating Talking Face Landmarks from Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

LVA/ICA 2018 | June 2018

Publication

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication Project

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication Project

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication Project

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

Target conversation extraction: Source separation using turn-taking dynamics

Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Knowledge boosting during low-latency inference

Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota

Interspeech 2024 | September 2024

Publication

Total-Duration-Aware Duration Modeling for Text-to-Speech Systems

Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda

Interspeech 2024 | September 2024

Publication

Real-Time Audio-Visual End-To-End Speech Enhancement

Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang

2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication

Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka

November 2022

Submitted to ICASSP 2023

Publication

Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net

Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang

November 2022

Submitted to ICASSP 2023

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation

Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang

Interspeech 2022 | September 2022

Publication

Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation

Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka

INTERSPEECH 2022 | September 2022

Publication

One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement

Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

Personalized Speech Enhancement: New Models and Comprehensive Evaluation

Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang

ICASSP 2022 | May 2022

Publication

ICASSP 2022 Deep Noise Suppression Challenge

Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner

ICASSP | May 2022

Publication Project

All-Neural Beamformer for Continuous Speech Separation

Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez

ICASSP 2022 | May 2022

Publication Project

Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement

Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka

Interspeech 2021 | August 2021

Preprint Project

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI Project

Sequence-Level Self-Learning with Multiple Hypotheses

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

Interspeech | October 2020

Publication DOI Project

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication Project

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication Project

End-To-End Generation of Talking Faces from Noisy Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020

Publication

Improving Readability for Automatic Speech Recognition Transcription

Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng

arXiv:2004.04438 | April 2020

Publication

Speech Super Resolution Generative Adversarial Network

Sefik Emre Eskimez, Kazuhito Koishida

ICASSP 2019 | May 2019

DOI Publication

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition

Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman

2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018

Publication

Generating Talking Face Landmarks from Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

LVA/ICA 2018 | June 2018

Publication

WISE: Web-based Interactive Speech Emotion Classification

Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

International Joint Conferences on Artificial Intelligence | July 2016

Publication

Emotion classification: How does an automated system compare to Naive human coders?

Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman

2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016

Publication

SpeechX: Neural Codec Language Model as a Versatile Speech Transformer

Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka

August 2023

Publication

Speech separation with large-scale self-supervised learning

Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez

arXiv:2211.05172 | November 2022

Publication

Noise-Resilient Training Method for Face Landmark Generation From Speech

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38

Publication

Adversarial Training for Speech Super-Resolution

Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan

IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358

DOI Publication

Front-end speech enhancement for commercial speaker verification systems

Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman

Speech Communication | May 2018, Vol 99: pp. 101-113

Publication

Federated Transfer Learning with Dynamic Gradient Aggregation

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

August 2020

Publication Project

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

Project