{"id":144940,"date":"2015-04-12T00:14:22","date_gmt":"2015-04-12T00:14:22","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/group\/machine-learning-natural-language-systems-and-applications\/"},"modified":"2024-01-29T05:35:50","modified_gmt":"2024-01-29T13:35:50","slug":"machine-learning-natural-language-systems-and-applications","status":"publish","type":"msr-group","link":"https:\/\/www.microsoft.com\/en-us\/research\/theme\/machine-learning-natural-language-systems-and-applications\/","title":{"rendered":"Machine Learning and AI | India"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background-catalina-blue card-background--full-bleed\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"960\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-scaled.jpg\" class=\"attachment-full size-full\" alt=\"Theme: Machine Learning and Natural Language Systems\" style=\"object-position: 78% 50%\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-scaled.jpg 2560w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-300x113.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-1024x384.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-768x288.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-1536x576.jpg 1536w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-2048x768.jpg 2048w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-1920x720.jpg 1920w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/12\/Theme_navy_ML-NLS-A_12_2019_1920x720-1600x600.jpg 1600w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 \">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-india\/\" class=\"icon-link icon-link--reverse mb-2\" data-bi-cN=\"Return to Microsoft Research Lab - India\">\n\t\t\t\t\t\t\t\t\t<span class=\"c-glyph glyph-chevron-left\" aria-hidden=\"true\"><\/span>\n\t\t\t\t\t\t\t\t\tReturn to Microsoft Research Lab &#8211; India\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 class=\"wp-block-heading h2\" id=\"machine-learning-and-ai-india\">Machine Learning and AI | India<\/h1>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<p>The ML and AI group at Microsoft Research India tackles some of the coolest, hardest, most fascinating, and impactful research problems in AI, ranging from theory to advances in large-scale AI models. Our research has won best paper awards at premier conferences and has benefitted hundreds of millions of people world-wide. See our\u202f<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/theme\/machine-learning-natural-language-systems-and-applications\/publications\/\" target=\"_blank\" rel=\"noreferrer noopener\">publications<\/a>\u202ffor examples of our work.&nbsp;<\/p>\n\n\n\n<p>The group offers a warm and welcoming environment where diverse people and projects thrive. We work hard to provide support mechanisms which allow people the flexibility to explore different paths to success, including:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Choosing to strive for excellence in individual projects vs collaborating in teams to achieve much more than any individual could.&nbsp;<\/li>\n\n\n\n<li>Pursuing fundamental research in core areas vs working on highly interdisciplinary projects at the intersection of artificial intelligence, machine learning, natural language processing, information retrieval, systems, theory, and related areas.&nbsp;<\/li>\n\n\n\n<li>Studying the theoretical foundations of problems vs taking an empirical approach and tackling applications end-to-end.&nbsp;<\/li>\n\n\n\n<li>Choosing the ideal mix of academic, social and product impact that is appropriate for each person.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>Researchers, engineers, and data scientists pursuing all these approaches have found success in our group at MSR India. In addition to exploring the frontiers of new research areas in a bottom-up fashion, we also provide top-down support for mature projects by facilitating research collaborations and providing strong engineering and data-science support.&nbsp;<\/p>\n\n\n\n<p>Here\u2019s a sample of our projects that are extending state-of-the-art for machine learning.&nbsp;&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/extreme-classification\/\" target=\"_blank\" rel=\"noreferrer noopener\">Extreme Classification:<\/a> This project tackles the largest classification problems in the world involving millions to billions of categories. It started out as a bottom-up exploration by an individual researcher in a core area of machine learning. After a decade, the project is still going strong and has evolved into an interdisciplinary project with key contributions from researchers in diverse areas of computer science and strong engineering support from the lab. Along the way, the project has started a new area of machine learning research which is thriving in both academia and industry. The extreme classification group has published highly impactful papers in leading conferences including ICML, KDD, NeurIPS, WSDM & WWW where the quality of their research has been recognized by best paper awards. The group also maintains the Extreme Classification Repository which has become a vital resource for carrying out open and reproducible academic research. At the same time, the group has won multiple awards for their impact and engineering excellence. As a result of all these contributions, as well as the group\u2019s open research policy towards publishing and the release of source code, extreme classifiers are now widely deployed in the tech industry where they are making billions of predictions a day, are improving the productivity of billions of people, and have significantly benefitted many businesses worldwide.&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Aligning AI models for large-scale decision-making: <\/strong>Some of the hardest problems in the world involve decision-making in large action spaces, such as in healthcare, robotics, information dissemination, and recommendations. Here we envision a new paradigm of dealing with missing data in decision-making scenarios by using large language models (LLMs) like GPT-4 for feedback and data augmentation, or directly as teachers for solving the task. To enable this paradigm, we are developing scalable RL-based algorithms for optimizing a model under non-differentiable rewards (based on LLMs or other task-specific constraints). Empirically, we are finding that LLMs bring complementary capabilities leading to state-of-the-art accuracy for diverse tasks such as learning a <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/causal-reasoning-and-large-language-models-opening-a-new-frontier-for-causality\/\" target=\"_blank\" rel=\"noreferrer noopener\">causal world model<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/arxiv.org\/abs\/2310.20158\" target=\"_blank\" rel=\"noreferrer noopener\">retrieving relevant documents from a corpus<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>..&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-vellm\/overview\/\" target=\"_blank\" rel=\"noreferrer noopener\">Making LLMs more inclusive to languages of the world:<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> Large Language Models are being used in various applications today and have the potential to revolutionize the future of work \u2013 however, current models <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/arxiv.org\/abs\/2303.12528\" target=\"_blank\" rel=\"noreferrer noopener\">perform worse for non-English languages compared to English<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, particularly for languages written in scripts other than the Latin script, and for low-resource languages. Our research focuses on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/arxiv.org\/abs\/2309.07462\" target=\"_blank\" rel=\"noreferrer noopener\">scaling up multilingual evaluation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> so that we can determine the strengths and weaknesses of models in non-English languages. We also work on parameter efficient fine-tuning methods for improving performance of LLMs on languages other than English.&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>AI4Code:<\/strong> One of the thriving AI research areas, and arguably the biggest beneficiary of generative AI is software engineering. At MSR India, we are going after some of the high-impact research questions around how to make robust generative AI-based systems to accelerate software engineering tasks, such as rewriting entire repositories to improve <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/frustrated-with-code-quality-issues-llms-can-help\/\" target=\"_blank\" rel=\"noreferrer noopener\">quality<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/fixing-rust-compilation-errors-using-llms\/\" target=\"_blank\" rel=\"noreferrer noopener\">fixing<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> compilation errors and repository-wide package <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/arxiv.org\/pdf\/2309.12499.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">migration<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, beyond code completion.&nbsp;&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Causal Machine Learning:<\/strong> To build reasoning systems of the future, a key ingredient is the ability to learn causal relationships from data. Our group has pioneered research at the intersection of causality and machine learning: using machine learning to increase robustness of causal effect inference methods, and developing causality-based algorithms for improving generalization of predictive machine learning models. To accelerate adoption of causality, we developed the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/py-why\/dowhy\" target=\"_blank\" rel=\"noreferrer noopener\">DoWhy<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> library as a research prototype. Today the library is widely deployed in industry and academia with over 2M installations and attracts contributions from leading universities of the world. We are also a founding member of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/pywhy.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">PyWhy<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, an open ecosystem for causal machine learning that is driving research towards end-to-end systems for causal learning.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>We are actively looking for exceptional researchers, engineers and data scientists in all areas of AI and ML. Please visit\u202f<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-india\/opportunities\/\" target=\"_blank\" rel=\"noreferrer noopener\">MSR India\u2019s career opportunities<\/a>\u202fpage to see what positions are currently open.&nbsp;<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>We work on various aspects of data-driven algorithms including fast machine learning algorithms that can learn from large scale and noisy data, learning from natural language and multilingual data, and applications of these algorithms to Web Search, Computational Advertisement, Recommendation Systems, Natural Language Systems, Music Retrieval, etc.<\/p>\n","protected":false},"featured_media":629124,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"msr_group_start":"","footnotes":""},"research-area":[13556,13545],"msr-group-type":[243688],"msr-locale":[268875],"msr-impact-theme":[264846],"class_list":["post-144940","msr-group","type-msr-group","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-human-language-technologies","msr-group-type-theme","msr-locale-en_us"],"msr_group_start":"","msr_detailed_description":"","msr_further_details":"","msr_hero_images":[],"msr_research_lab":[199562],"related-researchers":[{"type":"user_nicename","display_name":"Ramakrishna Bairi","user_id":36033,"people_section":"Group 1","alias":"rbairi"},{"type":"user_nicename","display_name":"Kalika Bali","user_id":32477,"people_section":"Group 1","alias":"kalikab"},{"type":"user_nicename","display_name":"Amit Deshpande","user_id":30988,"people_section":"Group 1","alias":"amitdesh"},{"type":"user_nicename","display_name":"Ankit Garg","user_id":36107,"people_section":"Group 1","alias":"garga"},{"type":"user_nicename","display_name":"Navin Goyal","user_id":33063,"people_section":"Group 1","alias":"navingo"},{"type":"user_nicename","display_name":"Arun Iyer","user_id":36299,"people_section":"Group 1","alias":"ariy"},{"type":"user_nicename","display_name":"Neeraj Kayal","user_id":33076,"people_section":"Group 1","alias":"neeraka"},{"type":"user_nicename","display_name":"Ravishankar Krishnaswamy","user_id":33330,"people_section":"Group 1","alias":"rakri"},{"type":"guest","display_name":"Pratyush Kumar","user_id":771130,"people_section":"Group 1","alias":""},{"type":"user_nicename","display_name":"Nipun Kwatra","user_id":37634,"people_section":"Group 1","alias":"nkwatra"},{"type":"user_nicename","display_name":"Sonu Mehta","user_id":37769,"people_section":"Group 1","alias":"someh"},{"type":"user_nicename","display_name":"Nagarajan Natarajan","user_id":37311,"people_section":"Group 1","alias":"nagarajn"},{"type":"user_nicename","display_name":"Suresh Parthasarathy","user_id":33762,"people_section":"Group 1","alias":"supartha"},{"type":"user_nicename","display_name":"Sriram Rajamani","user_id":33711,"people_section":"Group 1","alias":"sriram"},{"type":"user_nicename","display_name":"Ramachandran Ramjee","user_id":33337,"people_section":"Group 1","alias":"ramjee"},{"type":"guest","display_name":"Deepak Saini","user_id":795476,"people_section":"Group 1","alias":""},{"type":"user_nicename","display_name":"Rahul Sharma","user_id":36308,"people_section":"Group 1","alias":"rahsha"},{"type":"user_nicename","display_name":"Amit Sharma","user_id":30997,"people_section":"Group 1","alias":"amshar"},{"type":"user_nicename","display_name":"Harsha Simhadri","user_id":36146,"people_section":"Group 1","alias":"harshasi"},{"type":"user_nicename","display_name":"Sunayana Sitaram","user_id":37287,"people_section":"Group 1","alias":"susitara"},{"type":"user_nicename","display_name":"Manik Varma","user_id":32791,"people_section":"Group 1","alias":"manik"}],"related-publications":[545640,491447,488069,488078,487508,546150,482253,487088,482244,424689,424572,424578,352937,352916,268377,352928,276609,282941,424584,257880,255654,255615,255606,255663,238354,292328,255639,255522,255534,255549,255558,282950,255669,168314,168476,168434,168435,255567,255576,167501,167491,167492,167882,168840,167881,168397,167555,167600,168396,168398,167020,167599,167757,167758,166006,167759,168399,167598,167756,165245,164639,164627,163519,808075,686610,914793,760435,163521,808102,686616,954183,766408,165589,808117,704938,954192,793043,393422,808498,713995,954423,148204,793055,394229,812008,714004,963351,148214,807070,463914,812026,714010,968076,148215,808036,550788,812038,714016,968220,148216,808045,564657,812908,731377,968232,160368,808054,566862,853407,756028,968325,163515,808060,585106,862059,756592,163518,808066,631332,914265,756988],"related-downloads":[165246,167880,619632],"related-videos":[],"related-projects":[],"related-events":[],"related-opportunities":[],"related-posts":[],"tab-content":[],"msr_impact_theme":["Computing foundations"],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/144940"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-group"}],"version-history":[{"count":19,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/144940\/revisions"}],"predecessor-version":[{"id":1004208,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group\/144940\/revisions\/1004208"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/629124"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=144940"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=144940"},{"taxonomy":"msr-group-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-group-type?post=144940"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=144940"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=144940"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}