Barun Patra

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

ACL 2023 Multilingual Models Tutorial Slides

Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja

July 2023

Publication Project

Language Is Not All You Need: Aligning Perception with Language Models

Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

NeurIPS 2023 | March 2023

Publication

Invariant Language Modeling

Maxim Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Saurabh Tiwary, Robert West

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

ACL 2023 | October 2022

Work in progress

Publication

On Efficiently Acquiring Annotations for Multilingual Models

Joel Ruben Antony Moniz, Barun Patra, Matthew R. Gormley

ACL 2022 | May 2022

Publication

Invariant Language Modeling

Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

EMNLP 2022 | October 2021

Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints.

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

2020 Empirical Methods in Natural Language Processing | October 2020

Publication Project

ScopeIt: Scoping Task Relevant Sentences in Documents

Barun Patra, Vishwas Suryanarayanan, Chala Fufa, Pamela Bhattacharya, Charles Lee

International Conference on Computational Linguistics | January 2020

DOI Publication Publication Project

Compression and Localization in Reinforcement Learning for ATARI Games

Joel Ruben Antony Moniz, Sarthak Garg, Barun Patra

NeurIPS (Deep RL Workshop) | December 2018

Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

Language Is Not All You Need: Aligning Perception with Language Models

Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

NeurIPS 2023 | March 2023

Publication

Invariant Language Modeling

Maxim Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Saurabh Tiwary, Robert West

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

ACL 2023 | October 2022

Work in progress

Publication

Invariant Language Modeling

Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

EMNLP 2022 | October 2021

Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints.

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

2020 Empirical Methods in Natural Language Processing | October 2020

Publication Project

ScopeIt: Scoping Task Relevant Sentences in Documents

Barun Patra, Vishwas Suryanarayanan, Chala Fufa, Pamela Bhattacharya, Charles Lee

International Conference on Computational Linguistics | January 2020

DOI Publication Publication Project

Compression and Localization in Reinforcement Learning for ATARI Games

Joel Ruben Antony Moniz, Sarthak Garg, Barun Patra

NeurIPS (Deep RL Workshop) | December 2018

Publication

ACL 2023 Multilingual Models Tutorial Slides

Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja

July 2023

Publication Project

Invariant Language Modeling

Maxim Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Saurabh Tiwary, Robert West

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

ACL 2023 | October 2022

Work in progress

Publication

On Efficiently Acquiring Annotations for Multilingual Models

Joel Ruben Antony Moniz, Barun Patra, Matthew R. Gormley

ACL 2022 | May 2022

Publication

Invariant Language Modeling

Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

EMNLP 2022 | October 2021

Publication

Language Is Not All You Need: Aligning Perception with Language Models

Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

NeurIPS 2023 | March 2023

Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

ACL 2023 Multilingual Models Tutorial Slides

Kalika Bali, Monojit Choudhury, Sunayana Sitaram, Barun Patra, Vishrav Chaudhary, Kabir Ahuja

July 2023

Publication Project

Language Is Not All You Need: Aligning Perception with Language Models

Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei

NeurIPS 2023 | March 2023

Publication

Invariant Language Modeling

Maxim Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Saurabh Tiwary, Robert West

2022 Empirical Methods in Natural Language Processing | December 2022

Publication

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song

ACL 2023 | October 2022

Work in progress

Publication

On Efficiently Acquiring Annotations for Multilingual Models

Joel Ruben Antony Moniz, Barun Patra, Matthew R. Gormley

ACL 2022 | May 2022

Publication

Invariant Language Modeling

Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West

EMNLP 2022 | October 2021

Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

Empirical Methods in Natural Language Processing | October 2020

DOI PDF Publication Publication

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints.

Barun Patra, Chala Fufa, Pamela Bhattacharya, Charles Lee

2020 Empirical Methods in Natural Language Processing | October 2020

Publication Project

ScopeIt: Scoping Task Relevant Sentences in Documents

Barun Patra, Vishwas Suryanarayanan, Chala Fufa, Pamela Bhattacharya, Charles Lee

International Conference on Computational Linguistics | January 2020

DOI Publication Publication Project

Compression and Localization in Reinforcement Learning for ATARI Games

Joel Ruben Antony Moniz, Sarthak Garg, Barun Patra

NeurIPS (Deep RL Workshop) | December 2018

Publication