LEAP – Language, Learning, Audio, Privacy

Orca-2: Teaching Small Language Models How to Reason

Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andres Codas, Clarisse Simoes Ribeiro, Sahaj Agrawal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Aggarwal, Hamid Palangi, Guoqing Zheng, Corby Rosset, Hamed Khanpour, Ahmed Awadallah

November 2023

PDF 视频 下载 下载 项目

Multi-View Learning for Speech Emotion Recognition

Daniel Tompkins, Dimitra Emmanouilidou, Soham Deshmukh, Benjamin Elizalde

International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication 项目

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah

arXiv: Computation and Language | June 2023

PDF Publication 视频 项目

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata (Subho) Mukherjee, Yuchen Liu, Dongkuan Xu

arXiv: Computation and Language | May 2023

Publication

A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training

Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor

ACL 2023 | May 2023

Publication

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication 项目

Investigations in Audio Captioning: Addressing Vocabulary Imbalance and Evaluating Suitability of Language-Centric Performance Metrics

Sandeep Kothinti, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | May 2023

Publication 项目

What do Compressed Large Language Models Forget? Robustness Challenges in Model Compression

Mengnan Du, Subhabrata (Subho) Mukherjee, Yu Cheng, Milad Shokouhi, Xia Hu, Ahmed Awadallah

EACL | April 2023

Publication 项目 项目 项目

Accelerating Dataset Distillation via Model Augmentation

Lei Zhang, Jie Zhang, Bowen Lei, Subhabrata (Subho) Mukherjee, Xiang Pan, Bo Zhao, Caiwen Ding, Yao Li, Dongkuan Xu

2023 Computer Vision and Pattern Recognition | March 2023

Highlight paper (2.5%)

Publication

ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labels

Yue Zhao, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Robert McCann, Ahmed Awadallah

AAAI | January 2023

Publication

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication 项目

Boosting Natural Language Generation from Instructions with Meta-Learning

Budhaditya Deb, Guoqing Zheng, Ahmed Awadallah

EMNLP | December 2022

Publication

Imagining future digital assistants at work: A study of task management needs

Yonchanok Khaokaew, Indigo Holcombe-James, Mohammad Saiedur Rahaman, Jonathan Liono, Johanne R. Trippas, Damiano Spina, Peter Bailey, Nicholas J. Belkin, Paul Bennett, Yongli Ren, Mark Sanderson, Falk Scholer, Ryen W. White, Flora D. Salim

International Journal of Human-Computer Studies | December 2022, 第 168 卷

Publication

Periodic motion-based visual stimulus

Andrew D. Wilson, Ivan Tashev, Hannes Gamper, Ed Cutrell, David Johnston, Dimitra Emmanouilidou

MSR-TR-2022-37 | November 2022

作者：Microsoft

US-20220365599-A1

Publication 项目

Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning

Yae Jee Cho, Andre Manoel, Gauri Joshi, Robert Sim, Dimitrios Dimitriadis

IJCAI-ECAI’22 | August 2022

Publication 项目

Toxic Speech and Speech Emotions: Investigations of Audio-based Modeling and Intercorrelations

Wei-Cheng Lin, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | August 2022

Publication 项目

UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis

Fatemehsadat Mireshghallah, Vaishnavi Shrivastava, Milad Shokouhi, Taylor Berg-Kirkpatrick, Robert Sim, Dimitrios Dimitriadis

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL’22) | July 2022

Publication 项目

Privacy Leakage in Text Classification: A Data Extraction Approach

Adel Elmahdy, Huseyin Inan, Robert Sim

June 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github 项目 项目

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

Dimitrios Dimitriadis, Mirian Hipolito Garcia, Daniel Madrigal, Andre Manoel, Robert Sim

March 2022

Preprint Github 项目

Population-scale dietary interests during the COVID-19 pandemic.

Kristina Gligoric, Arnaud Chiolero, Emre Kiciman, Ryen W. White, Robert West

Nature Communications | February 2022, 第 13 卷(1073)

Publication DOI 视频 项目

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github 项目

Fairness via Representation Neutralization

Mengnan Du, Subhabrata (Subho) Mukherjee, Guanchu Wang, Ruixiang Tang, Ahmed Awadallah, Xia Hu

NeurIPS 2021 | December 2021

Publication 项目

A Review of Speaker Diarization: Recent Advances with Deep Learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language | November 2021, 第 72 卷

Publication Publication

Say `YES’ to Positivity: Detecting Toxic Language in Workplace Communications

Meghana Moorthy Bhat, Saghar Hosseini, Ahmed Awadallah, Paul Bennett, Weisheng Li

EMNLP 2021 | November 2021

Publication

Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLU

Meghana Moorthy Bhat, Alessandro Sordoni, Subhabrata (Subho) Mukherjee

EMNLP 2021 | November 2021

Publication 项目 项目

Tackling Dynamics in Federated Incremental Learning with Variational Embedding Rehearsal

Tae Jin Park, Kenichi Kumatani, Dimitrios Dimitriadis

October 2021

Publication 项目

Meta Self-training for Few-shot Neural Sequence Labeling

Yaqing Wang, Subhabrata (Subho) Mukherjee, Haoda Chu, Yuancheng Tu, Ming Wu, Jing Gao, Ahmed Awadallah

SIGKDD 2021 (Research Track) | August 2021

Publication Github 项目

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI 项目

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction

Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah

NAACL 2021 | June 2021

Publication 项目

Structure-Grounded Pretraining for Text-to-SQL

Xiang Deng, Ahmed Awadallah, Chris Meek, Alex Polozov, Huan Sun, Matthew Richardson

NAACL 2021 | June 2021

PDF Publication 项目

XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation

Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao

ArXiv | June 2021

arXiv:2106.04563

Publication Github 项目 项目

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

Mengzhou Xia, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Milad Shokouhi, Graham Neubig, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目

Self-training with Weak Supervision

Giannis Karamanolakis, Subhabrata (Subho) Mukherjee, Guoqing Zheng, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目 项目

SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing

Tao Yu, Rui Zhang, Alex Polozov, Chris Meek, Ahmed Awadallah

ICLR | May 2021

Publication 项目

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, Dragomir R. Radev

NAACL | April 2021

Publication

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication 项目

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication 项目

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

项目

Intelligent Task Recognition: Towards Enabling Productivity Assistance in Daily Life

Jonathan Liono, Mohammad Saiedur Rahaman, Flora D Salim, Yongli Ren, Damiano Spina, Falk Scholer, Johanne R Trippas, Mark Sanderson, Ryen W. White, Paul Bennett

2020 International Conference on Multimedia Retrieval | June 2020

Publication

Orca-2: Teaching Small Language Models How to Reason

Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andres Codas, Clarisse Simoes Ribeiro, Sahaj Agrawal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Aggarwal, Hamid Palangi, Guoqing Zheng, Corby Rosset, Hamed Khanpour, Ahmed Awadallah

November 2023

PDF 视频 下载 下载 项目

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah

arXiv: Computation and Language | June 2023

PDF Publication 视频 项目

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata (Subho) Mukherjee, Yuchen Liu, Dongkuan Xu

arXiv: Computation and Language | May 2023

Publication

A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training

Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor

ACL 2023 | May 2023

Publication

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication 项目

Accelerating Dataset Distillation via Model Augmentation

Lei Zhang, Jie Zhang, Bowen Lei, Subhabrata (Subho) Mukherjee, Xiang Pan, Bo Zhao, Caiwen Ding, Yao Li, Dongkuan Xu

2023 Computer Vision and Pattern Recognition | March 2023

Highlight paper (2.5%)

Publication

ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labels

Yue Zhao, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Robert McCann, Ahmed Awadallah

AAAI | January 2023

Publication

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication 项目

Boosting Natural Language Generation from Instructions with Meta-Learning

Budhaditya Deb, Guoqing Zheng, Ahmed Awadallah

EMNLP | December 2022

Publication

Imagining future digital assistants at work: A study of task management needs

Yonchanok Khaokaew, Indigo Holcombe-James, Mohammad Saiedur Rahaman, Jonathan Liono, Johanne R. Trippas, Damiano Spina, Peter Bailey, Nicholas J. Belkin, Paul Bennett, Yongli Ren, Mark Sanderson, Falk Scholer, Ryen W. White, Flora D. Salim

International Journal of Human-Computer Studies | December 2022, 第 168 卷

Publication

Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning

Yae Jee Cho, Andre Manoel, Gauri Joshi, Robert Sim, Dimitrios Dimitriadis

IJCAI-ECAI’22 | August 2022

Publication 项目

UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis

Fatemehsadat Mireshghallah, Vaishnavi Shrivastava, Milad Shokouhi, Taylor Berg-Kirkpatrick, Robert Sim, Dimitrios Dimitriadis

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL’22) | July 2022

Publication 项目

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github 项目 项目

FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

Dimitrios Dimitriadis, Mirian Hipolito Garcia, Daniel Madrigal, Andre Manoel, Robert Sim

March 2022

Preprint Github 项目

Population-scale dietary interests during the COVID-19 pandemic.

Kristina Gligoric, Arnaud Chiolero, Emre Kiciman, Ryen W. White, Robert West

Nature Communications | February 2022, 第 13 卷(1073)

Publication DOI 视频 项目

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github 项目

Fairness via Representation Neutralization

Mengnan Du, Subhabrata (Subho) Mukherjee, Guanchu Wang, Ruixiang Tang, Ahmed Awadallah, Xia Hu

NeurIPS 2021 | December 2021

Publication 项目

A Review of Speaker Diarization: Recent Advances with Deep Learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language | November 2021, 第 72 卷

Publication Publication

Tackling Dynamics in Federated Incremental Learning with Variational Embedding Rehearsal

Tae Jin Park, Kenichi Kumatani, Dimitrios Dimitriadis

October 2021

Publication 项目

Meta Self-training for Few-shot Neural Sequence Labeling

Yaqing Wang, Subhabrata (Subho) Mukherjee, Haoda Chu, Yuancheng Tu, Ming Wu, Jing Gao, Ahmed Awadallah

SIGKDD 2021 (Research Track) | August 2021

Publication Github 项目

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI 项目

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction

Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah

NAACL 2021 | June 2021

Publication 项目

Structure-Grounded Pretraining for Text-to-SQL

Xiang Deng, Ahmed Awadallah, Chris Meek, Alex Polozov, Huan Sun, Matthew Richardson

NAACL 2021 | June 2021

PDF Publication 项目

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

Mengzhou Xia, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Milad Shokouhi, Graham Neubig, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目

SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing

Tao Yu, Rui Zhang, Alex Polozov, Chris Meek, Ahmed Awadallah

ICLR | May 2021

Publication 项目

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, Dragomir R. Radev

NAACL | April 2021

Publication

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

项目

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication 项目

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication 项目

Orca-2: Teaching Small Language Models How to Reason

Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andres Codas, Clarisse Simoes Ribeiro, Sahaj Agrawal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Aggarwal, Hamid Palangi, Guoqing Zheng, Corby Rosset, Hamed Khanpour, Ahmed Awadallah

November 2023

PDF 视频 下载 下载 项目

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah

arXiv: Computation and Language | June 2023

PDF Publication 视频 项目

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata (Subho) Mukherjee, Yuchen Liu, Dongkuan Xu

arXiv: Computation and Language | May 2023

Publication

A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training

Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor

ACL 2023 | May 2023

Publication

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication 项目

What do Compressed Large Language Models Forget? Robustness Challenges in Model Compression

Mengnan Du, Subhabrata (Subho) Mukherjee, Yu Cheng, Milad Shokouhi, Xia Hu, Ahmed Awadallah

EACL | April 2023

Publication 项目 项目 项目

ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labels

Yue Zhao, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Robert McCann, Ahmed Awadallah

AAAI | January 2023

Publication

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication 项目

UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis

Fatemehsadat Mireshghallah, Vaishnavi Shrivastava, Milad Shokouhi, Taylor Berg-Kirkpatrick, Robert Sim, Dimitrios Dimitriadis

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL’22) | July 2022

Publication 项目

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github 项目 项目

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github 项目

A Review of Speaker Diarization: Recent Advances with Deep Learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language | November 2021, 第 72 卷

Publication Publication

Say `YES’ to Positivity: Detecting Toxic Language in Workplace Communications

Meghana Moorthy Bhat, Saghar Hosseini, Ahmed Awadallah, Paul Bennett, Weisheng Li

EMNLP 2021 | November 2021

Publication

Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLU

Meghana Moorthy Bhat, Alessandro Sordoni, Subhabrata (Subho) Mukherjee

EMNLP 2021 | November 2021

Publication 项目 项目

Meta Self-training for Few-shot Neural Sequence Labeling

Yaqing Wang, Subhabrata (Subho) Mukherjee, Haoda Chu, Yuancheng Tu, Ming Wu, Jing Gao, Ahmed Awadallah

SIGKDD 2021 (Research Track) | August 2021

Publication Github 项目

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation

Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao

ArXiv | June 2021

arXiv:2106.04563

Publication Github 项目 项目

NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction

Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah

NAACL 2021 | June 2021

Publication 项目

Structure-Grounded Pretraining for Text-to-SQL

Xiang Deng, Ahmed Awadallah, Chris Meek, Alex Polozov, Huan Sun, Matthew Richardson

NAACL 2021 | June 2021

PDF Publication 项目

Self-training with Weak Supervision

Giannis Karamanolakis, Subhabrata (Subho) Mukherjee, Guoqing Zheng, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目 项目

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

Mengzhou Xia, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Milad Shokouhi, Graham Neubig, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目

SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing

Tao Yu, Rui Zhang, Alex Polozov, Chris Meek, Ahmed Awadallah

ICLR | May 2021

Publication 项目

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, Dragomir R. Radev

NAACL | April 2021

Publication

Accelerating Dataset Distillation via Model Augmentation

Lei Zhang, Jie Zhang, Bowen Lei, Subhabrata (Subho) Mukherjee, Xiang Pan, Bo Zhao, Caiwen Ding, Yao Li, Dongkuan Xu

2023 Computer Vision and Pattern Recognition | March 2023

Highlight paper (2.5%)

Publication

Multi-View Learning for Speech Emotion Recognition

Daniel Tompkins, Dimitra Emmanouilidou, Soham Deshmukh, Benjamin Elizalde

International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication 项目

Investigations in Audio Captioning: Addressing Vocabulary Imbalance and Evaluating Suitability of Language-Centric Performance Metrics

Sandeep Kothinti, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | May 2023

Publication 项目

Toxic Speech and Speech Emotions: Investigations of Audio-based Modeling and Intercorrelations

Wei-Cheng Lin, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | August 2022

Publication 项目

A Review of Speaker Diarization: Recent Advances with Deep Learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language | November 2021, 第 72 卷

Publication Publication

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

Periodic motion-based visual stimulus

Andrew D. Wilson, Ivan Tashev, Hannes Gamper, Ed Cutrell, David Johnston, Dimitra Emmanouilidou

MSR-TR-2022-37 | November 2022

作者：Microsoft

US-20220365599-A1

Publication 项目

Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning

Yae Jee Cho, Andre Manoel, Gauri Joshi, Robert Sim, Dimitrios Dimitriadis

IJCAI-ECAI’22 | August 2022

Publication 项目

Tackling Dynamics in Federated Incremental Learning with Variational Embedding Rehearsal

Tae Jin Park, Kenichi Kumatani, Dimitrios Dimitriadis

October 2021

Publication 项目

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

项目

Imagining future digital assistants at work: A study of task management needs

Yonchanok Khaokaew, Indigo Holcombe-James, Mohammad Saiedur Rahaman, Jonathan Liono, Johanne R. Trippas, Damiano Spina, Peter Bailey, Nicholas J. Belkin, Paul Bennett, Yongli Ren, Mark Sanderson, Falk Scholer, Ryen W. White, Flora D. Salim

International Journal of Human-Computer Studies | December 2022, 第 168 卷

Publication

Periodic motion-based visual stimulus

Andrew D. Wilson, Ivan Tashev, Hannes Gamper, Ed Cutrell, David Johnston, Dimitra Emmanouilidou

MSR-TR-2022-37 | November 2022

作者：Microsoft

US-20220365599-A1

Publication 项目

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

项目

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication 项目

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication 项目

Population-scale dietary interests during the COVID-19 pandemic.

Kristina Gligoric, Arnaud Chiolero, Emre Kiciman, Ryen W. White, Robert West

Nature Communications | February 2022, 第 13 卷(1073)

Publication DOI 视频 项目

Meta Self-training for Few-shot Neural Sequence Labeling

Yaqing Wang, Subhabrata (Subho) Mukherjee, Haoda Chu, Yuancheng Tu, Ming Wu, Jing Gao, Ahmed Awadallah

SIGKDD 2021 (Research Track) | August 2021

Publication Github 项目

Intelligent Task Recognition: Towards Enabling Productivity Assistance in Daily Life

Jonathan Liono, Mohammad Saiedur Rahaman, Flora D Salim, Yongli Ren, Damiano Spina, Falk Scholer, Johanne R Trippas, Mark Sanderson, Ryen W. White, Paul Bennett

2020 International Conference on Multimedia Retrieval | June 2020

Publication

Privacy Leakage in Text Classification: A Data Extraction Approach

Adel Elmahdy, Huseyin Inan, Robert Sim

June 2022

Publication

FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

Dimitrios Dimitriadis, Mirian Hipolito Garcia, Daniel Madrigal, Andre Manoel, Robert Sim

March 2022

Preprint Github 项目

Population-scale dietary interests during the COVID-19 pandemic.

Kristina Gligoric, Arnaud Chiolero, Emre Kiciman, Ryen W. White, Robert West

Nature Communications | February 2022, 第 13 卷(1073)

Publication DOI 视频 项目

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication 项目

Orca-2: Teaching Small Language Models How to Reason

Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andres Codas, Clarisse Simoes Ribeiro, Sahaj Agrawal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Aggarwal, Hamid Palangi, Guoqing Zheng, Corby Rosset, Hamed Khanpour, Ahmed Awadallah

November 2023

PDF 视频 下载 下载 项目

Privacy Leakage in Text Classification: A Data Extraction Approach

Adel Elmahdy, Huseyin Inan, Robert Sim

June 2022

Publication

FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

Dimitrios Dimitriadis, Mirian Hipolito Garcia, Daniel Madrigal, Andre Manoel, Robert Sim

March 2022

Preprint Github 项目

Tackling Dynamics in Federated Incremental Learning with Variational Embedding Rehearsal

Tae Jin Park, Kenichi Kumatani, Dimitrios Dimitriadis

October 2021

Publication 项目

Multi-View Learning for Speech Emotion Recognition

Daniel Tompkins, Dimitra Emmanouilidou, Soham Deshmukh, Benjamin Elizalde

International Conference on Acoustics, Speech and Signal Processing | June 2023

Publication 项目

A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training

Nitay Calderon, Subhabrata (Subho) Mukherjee, Roi Reichart, Amir Kantor

ACL 2023 | May 2023

Publication

Investigations in Audio Captioning: Addressing Vocabulary Imbalance and Evaluating Suitability of Language-Centric Performance Metrics

Sandeep Kothinti, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | May 2023

Publication 项目

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication 项目

What do Compressed Large Language Models Forget? Robustness Challenges in Model Compression

Mengnan Du, Subhabrata (Subho) Mukherjee, Yu Cheng, Milad Shokouhi, Xia Hu, Ahmed Awadallah

EACL | April 2023

Publication 项目 项目 项目

Accelerating Dataset Distillation via Model Augmentation

Lei Zhang, Jie Zhang, Bowen Lei, Subhabrata (Subho) Mukherjee, Xiang Pan, Bo Zhao, Caiwen Ding, Yao Li, Dongkuan Xu

2023 Computer Vision and Pattern Recognition | March 2023

Highlight paper (2.5%)

Publication

ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labels

Yue Zhao, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Robert McCann, Ahmed Awadallah

AAAI | January 2023

Publication

Boosting Natural Language Generation from Instructions with Meta-Learning

Budhaditya Deb, Guoqing Zheng, Ahmed Awadallah

EMNLP | December 2022

Publication

Toxic Speech and Speech Emotions: Investigations of Audio-based Modeling and Intercorrelations

Wei-Cheng Lin, Dimitra Emmanouilidou

European Signal Processing Conference (EUSIPCO) | August 2022

Publication 项目

Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning

Yae Jee Cho, Andre Manoel, Gauri Joshi, Robert Sim, Dimitrios Dimitriadis

IJCAI-ECAI’22 | August 2022

Publication 项目

UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis

Fatemehsadat Mireshghallah, Vaishnavi Shrivastava, Milad Shokouhi, Taylor Berg-Kirkpatrick, Robert Sim, Dimitrios Dimitriadis

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL’22) | July 2022

Publication 项目

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github 项目

Fairness via Representation Neutralization

Mengnan Du, Subhabrata (Subho) Mukherjee, Guanchu Wang, Ruixiang Tang, Ahmed Awadallah, Xia Hu

NeurIPS 2021 | December 2021

Publication 项目

Say `YES’ to Positivity: Detecting Toxic Language in Workplace Communications

Meghana Moorthy Bhat, Saghar Hosseini, Ahmed Awadallah, Paul Bennett, Weisheng Li

EMNLP 2021 | November 2021

Publication

Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLU

Meghana Moorthy Bhat, Alessandro Sordoni, Subhabrata (Subho) Mukherjee

EMNLP 2021 | November 2021

Publication 项目 项目

Meta Self-training for Few-shot Neural Sequence Labeling

Yaqing Wang, Subhabrata (Subho) Mukherjee, Haoda Chu, Yuancheng Tu, Ming Wu, Jing Gao, Ahmed Awadallah

SIGKDD 2021 (Research Track) | August 2021

Publication Github 项目

One-Shot Voice Conversion with Speaker-Agnostic StarGAN

Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr

INTERSPEECH 2022 | August 2021

Publication DOI 项目

Ensemble Combination between Different Time Segmentations

Jeremy Wong, Dimitrios Dimitriadis, Kenichi Kumatani, Yashesh Gaur, George Polovets, Partha Parthasarathy, Eric Sun, Jinyu Li, Yifan Gong

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | June 2021

Publication

NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction

Ahmed Elgohary, Chris Meek, Matthew Richardson, Adam Fourney, Gonzalo Ramos, Ahmed Awadallah

NAACL 2021 | June 2021

Publication 项目

Structure-Grounded Pretraining for Text-to-SQL

Xiang Deng, Ahmed Awadallah, Chris Meek, Alex Polozov, Huan Sun, Matthew Richardson

NAACL 2021 | June 2021

PDF Publication 项目

Self-training with Weak Supervision

Giannis Karamanolakis, Subhabrata (Subho) Mukherjee, Guoqing Zheng, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目 项目

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

Mengzhou Xia, Guoqing Zheng, Subhabrata (Subho) Mukherjee, Milad Shokouhi, Graham Neubig, Ahmed Awadallah

NAACL 2021 | May 2021

Publication Github 项目

SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing

Tao Yu, Rui Zhang, Alex Polozov, Chris Meek, Ahmed Awadallah

ICLR | May 2021

Publication 项目

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Ming Zhong, Da Yin, Tao Yu, Ahmad Zaidi, Mutethia Mutuma, Rahul Jha, Ahmed Awadallah, Asli Celikyilmaz, Yang Liu, Xipeng Qiu, Dragomir R. Radev

NAACL | April 2021

Publication

GAN-based Data Generation for Speech Emotion Recognition

Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani

INTERSPEECH 2020 | October 2020

Publication 项目

A Federated Approach in Training Acoustic Models

Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez

INTERSPEECH 2020 | October 2020

Publication 项目

Intelligent Task Recognition: Towards Enabling Productivity Assistance in Daily Life

Jonathan Liono, Mohammad Saiedur Rahaman, Flora D Salim, Yongli Ren, Damiano Spina, Falk Scholer, Johanne R Trippas, Mark Sanderson, Ryen W. White, Paul Bennett

2020 International Conference on Multimedia Retrieval | June 2020

Publication

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Subhabrata (Subho) Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, Ahmed Awadallah

arXiv: Computation and Language | June 2023

PDF Publication 视频 项目

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata (Subho) Mukherjee, Yuchen Liu, Dongkuan Xu

arXiv: Computation and Language | May 2023

Publication

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication 项目

Imagining future digital assistants at work: A study of task management needs

Yonchanok Khaokaew, Indigo Holcombe-James, Mohammad Saiedur Rahaman, Jonathan Liono, Johanne R. Trippas, Damiano Spina, Peter Bailey, Nicholas J. Belkin, Paul Bennett, Yongli Ren, Mark Sanderson, Falk Scholer, Ryen W. White, Flora D. Salim

International Journal of Human-Computer Studies | December 2022, 第 168 卷

Publication

Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao

ArXiv | April 2022

Publication

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github 项目 项目

Population-scale dietary interests during the COVID-19 pandemic.

Kristina Gligoric, Arnaud Chiolero, Emre Kiciman, Ryen W. White, Robert West

Nature Communications | February 2022, 第 13 卷(1073)

Publication DOI 视频 项目

A Review of Speaker Diarization: Recent Advances with Deep Learning

Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan

Computer Speech & Language | November 2021, 第 72 卷

Publication Publication

XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation

Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao

ArXiv | June 2021

arXiv:2106.04563

Publication Github 项目 项目

Periodic motion-based visual stimulus

Andrew D. Wilson, Ivan Tashev, Hannes Gamper, Ed Cutrell, David Johnston, Dimitra Emmanouilidou

MSR-TR-2022-37 | November 2022

作者：Microsoft

US-20220365599-A1

Publication 项目

Sequence-level self-learning with multi-task learning framework

Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng

October 2020

项目