{"id":793331,"date":"2021-11-16T08:00:04","date_gmt":"2021-11-16T16:00:04","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=793331"},"modified":"2021-11-08T10:45:23","modified_gmt":"2021-11-08T18:45:23","slug":"keynote-learning-from-observation-small-data-approach-to-human-common-sense","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/keynote-learning-from-observation-small-data-approach-to-human-common-sense\/","title":{"rendered":"Keynote: Learning from observation: Small-data approach to human common sense"},"content":{"rendered":"<p>Speaker: Katsushi Ikeuchi, Sr. Principal Research Manager, Microsoft Research Redmond<\/p>\n<p>Learning-from-Observation (LfO), a robot-teaching paradigm, aims to build a robot system that understands what humans do through a small number of human observations and map them to action. Unlike the more popular Learning-from-Demonstration paradigm, in which the robot itself is directly manipulated and the demonstration is repeated many times, Learning-from-Observation uses accumulated robotics knowledge from a small number of demonstrations through explicit steps and formulates it into task models to achieve a goal. In this session, we\u2019ll briefly introduce the basic design concepts of specific task models, shared and formulated through earlier system designs. We\u2019ll then discuss the formulation of common sense, required to achieve household tasks such as wiping a tabletop or bringing a cup of tea without spilling, into explicit task models. We\u2019ll also discuss task recognition through these task models from visual and verbal cues and the implementation of robust execution modules pre-trained by reinforcement learning.<\/p>\n<p>Learn more about the 2021 Microsoft Research Summit: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/Aka.ms\/researchsummit\">https:\/\/Aka.ms\/researchsummit<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Speaker: Katsushi Ikeuchi, Sr. Principal Research Manager, Microsoft Research Redmond Learning-from-Observation (LfO), a robot-teaching paradigm, aims to build a robot system that understands what humans do through a small number of human observations and map them to action. Unlike the more popular Learning-from-Demonstration paradigm, in which the robot itself is directly manipulated and the demonstration [&hellip;]<\/p>\n","protected":false},"featured_media":793334,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13562,13551],"msr-video-type":[261263,261326],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-793331","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-graphics-and-multimedia","msr-video-type-research-summit-2021","msr-video-type-towards-human-like-visual-learning-reasoning","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/aaQmejIE0sQ","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/793331"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/793331\/revisions"}],"predecessor-version":[{"id":793340,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/793331\/revisions\/793340"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/793334"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=793331"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=793331"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=793331"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=793331"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=793331"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=793331"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=793331"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}