{"id":789932,"date":"2021-11-16T08:00:42","date_gmt":"2021-11-16T16:00:42","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=789932"},"modified":"2021-10-30T11:29:45","modified_gmt":"2021-10-30T18:29:45","slug":"research-talk-resource-efficient-learning-for-large-pretrained-models","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/research-talk-resource-efficient-learning-for-large-pretrained-models\/","title":{"rendered":"Research talk: Resource-efficient learning for large pretrained models"},"content":{"rendered":"<p>At Microsoft Research, we are approaching large-scale AI from many different perspectives, which include not only creating new, bigger models, but also developing unique ways of optimizing AI models from training to deployment. One of the main challenges posed by larger AI models is that they are more difficult to deploy in an affordable and sustainable way, and it is also still hard for them to learn new concepts and tasks effectively. Join Microsoft Researcher Subho Mukherjee for the second of three lightning talks in this series on Efficient and adaptable large-scale AI. See talks from Microsoft Researchers Yu Cheng and Guoqing Zheng to learn more about the work Microsoft is doing to improve the efficiency of computation and data in large-scale AI models.<\/p>\n<p>Learn more about the 2021 Microsoft Research Summit: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/Aka.ms\/researchsummit\">https:\/\/Aka.ms\/researchsummit<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>At Microsoft Research, we are approaching large-scale AI from many different perspectives, which include not only creating new, bigger models, but also developing unique ways of optimizing AI models from training to deployment. One of the main challenges posed by larger AI models is that they are more difficult to deploy in an affordable and [&hellip;]<\/p>\n","protected":false},"featured_media":789935,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-video-type":[261269,261263],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-789932","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-video-type-deep-learning-large-scale-ai","msr-video-type-research-summit-2021","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/lP0ZyHmlMS8","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/789932"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/789932\/revisions"}],"predecessor-version":[{"id":789938,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/789932\/revisions\/789938"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/789935"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=789932"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=789932"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=789932"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=789932"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=789932"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=789932"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=789932"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}