{"id":727042,"date":"2021-03-17T04:47:23","date_gmt":"2021-03-17T11:47:23","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=727042"},"modified":"2022-03-08T08:36:31","modified_gmt":"2022-03-08T16:36:31","slug":"robotics-and-mixed-reality","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/robotics-and-mixed-reality\/","title":{"rendered":"Robotics and Mixed Reality"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background- card-background--full-bleed\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"1920\" height=\"720\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped.jpg\" class=\"attachment-full size-full\" alt=\"\" style=\"\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped.jpg 1920w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-300x113.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-1024x384.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-768x288.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-1536x576.jpg 1536w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-16x6.jpg 16w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/EricV_and_spot_cropped-1600x600.jpg 1600w\" sizes=\"(max-width: 1920px) 100vw, 1920px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 align-self-center\">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 id=\"robotics-and-mixed-reality\" class=\"h2\">Robotics and Mixed Reality<\/h1>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<div class=\"wp-block-image is-style-default\"><figure class=\"alignright size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"574\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-1024x574.jpg\" alt=\"virtual reality image of an outstretched hand in front of the user\" class=\"wp-image-727402\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-1024x574.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-300x168.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-768x431.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-16x9.jpg 16w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-655x368.jpg 655w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-343x193.jpg 343w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image-640x360.jpg 640w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2021\/02\/website_main_image.jpg 1460w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/div>\n\n\n\n<p>As robots become more ubiquitous in our homes and workplaces, humans need a way to intuitively interact with them: to control them without requiring special training, to visualize and understand their intentions, and to utilize the spatial data that they produce.&nbsp;Mixed Reality devices (both HoloLens and AR-capable mobile devices) are solving the same localization and mapping problems as mobile robots.&nbsp;In order to function, they need to understand the space around them and know where they are in their environment.&nbsp;Our research efforts in this domain focus on developing methods to better localize robots and humans together, and approaches for leveraging spatial intelligence and the sensing capabilities of Mixed Reality devices to enable easier, safer, and more effective human-robot interaction.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>Our research efforts focus on developing methods to better localize robots and humans together, and approaches for leveraging spatial intelligence and the sensing capabilities of Mixed Reality devices to enable easier, safer, and more effective human-robot interaction.<\/p>\n","protected":false},"featured_media":727381,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13562,13552,13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-727042","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-hardware-devices","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[685404,727504],"related-downloads":[701536],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Jeffrey Delmerico","user_id":38562,"people_section":"Section name 0","alias":"jedelmer"},{"type":"user_nicename","display_name":"Marc Pollefeys","user_id":36191,"people_section":"Section name 0","alias":"mapoll"},{"type":"user_nicename","display_name":"Mario Gini","user_id":40540,"people_section":"Section name 0","alias":"mariogini"},{"type":"guest","display_name":"Eric Vollenweider","user_id":708409,"people_section":"Section name 0","alias":""}],"msr_research_lab":[602418],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/727042"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":7,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/727042\/revisions"}],"predecessor-version":[{"id":968100,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/727042\/revisions\/968100"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/727381"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=727042"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=727042"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=727042"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=727042"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=727042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}