{"id":794057,"date":"2021-11-16T08:00:54","date_gmt":"2021-11-16T16:00:54","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=794057"},"modified":"2021-11-09T14:49:12","modified_gmt":"2021-11-09T22:49:12","slug":"research-talk-making-deep-reinforcement-learning-industrially-applicable","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/research-talk-making-deep-reinforcement-learning-industrially-applicable\/","title":{"rendered":"Research talk: Making deep reinforcement learning industrially applicable"},"content":{"rendered":"<p>Deep reinforcement learning has achieved remarkable success, especially in gaming and other applications whose environments are artificial or are associated with low exploration costs. However, for most critical industrial applications, interactions with the environments are very costly\u2014and bad explorations might lead to a disaster. In this situation, a new paradigm of deep reinforcement learning is greatly needed. In this talk, the researchers will introduce a new framework called continual offline reinforcement learning and discuss how to better trade off between policy improvement and global convergence in this framework. They will also discuss how to evaluate an offline learned policy in a more accurate manner before deploying it into real environments. After that, they will introduce several real examples, in which continual offline reinforcement learning was applied to solve difficult problems in the industrial domains of logistics and supply chain. At the end, the researchers will discuss remaining challenges and technical trends in this important space.<\/p>\n<p>Learn more about the 2021 Microsoft Research Summit: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/Aka.ms\/researchsummit\">https:\/\/Aka.ms\/researchsummit<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Deep reinforcement learning has achieved remarkable success, especially in gaming and other applications whose environments are artificial or are associated with low exploration costs. However, for most critical industrial applications, interactions with the environments are very costly\u2014and bad explorations might lead to a disaster. In this situation, a new paradigm of deep reinforcement learning is [&hellip;]<\/p>\n","protected":false},"featured_media":794060,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"research-area":[13556],"msr-video-type":[261263,261311],"msr-locale":[268875],"msr-post-option":[],"msr-session-type":[],"msr-impact-theme":[],"msr-pillar":[],"msr-episode":[],"msr-research-theme":[],"class_list":["post-794057","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-video-type-research-summit-2021","msr-video-type-reinforcement-learning","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/aNQ60o8QwyU","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/794057","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/794057\/revisions"}],"predecessor-version":[{"id":794063,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/794057\/revisions\/794063"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/794060"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=794057"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=794057"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=794057"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=794057"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=794057"},{"taxonomy":"msr-session-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-session-type?post=794057"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=794057"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=794057"},{"taxonomy":"msr-episode","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-episode?post=794057"},{"taxonomy":"msr-research-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-theme?post=794057"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}