{"id":736774,"date":"2020-11-23T11:31:32","date_gmt":"2020-11-23T19:31:32","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=736774"},"modified":"2021-03-29T13:34:01","modified_gmt":"2021-03-29T20:34:01","slug":"camera-based-non-contact-health-sensing-webinar","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/camera-based-non-contact-health-sensing-webinar\/","title":{"rendered":"Camera-based non-contact health sensing webinar"},"content":{"rendered":"<p>The SARS-CoV-2 (COVID-19) pandemic is transforming the face of healthcare around the world. One example of this transformation can be seen in the number of medical appointments held via teleconference, which has increased by more than an order of magnitude because of stay-at-home orders and greater burdens on healthcare systems. Experts suggest that particular attention should be given to cardiovascular and pulmonary protection during treatment for COVID-19. However, in most telehealth scenarios physicians lack access to objective measurements of a patient\u2019s condition because of the inability to capture vital signs.<\/p>\n<p>In this webinar, Microsoft Principal Researcher Daniel McDuff and University of Washington PhD student Xin Liu will present an overview of computer vision methods that leverage ordinary webcams to measure physiological signals (for example, peripheral blood flow, heart rate, respiration, and blood oxygenation) without contact with the body. Learn about some examples of state-of-the-art neural models that enable on-device sensing even in resource-constrained settings and understand some of the challenges and exciting research opportunities in this space. This webinar will frame the application of these methods in the context of telehealth; however, non-contact physiological measurement also holds promise in broader health, well-being, and affective computing settings.<\/p>\n<p>Together, you\u2019ll explore:<\/p>\n<ul>\n<li>The optical and physiological basis for camera-based sensing.<\/li>\n<li>State-of-the-art, on-device algorithms for fast, scalable, and privacy-preserving measurement.<\/li>\n<li>Future challenges, open research questions, and opportunities in this space.<\/li>\n<\/ul>\n<p><strong>Resource list:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/multi-task-temporal-shift-attention-networks-for-on-device-contactless-vitals-measurement\/\">Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement<\/a> (publication)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/xin71\/MTTS-CAN\">MTTS-CAN<\/a> (Github)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/danmcduff\/iphys-toolbox\">iPhys-Toolbox<\/a> (Github)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/homes.cs.washington.edu\/~xliu0\/\">Xin Liu<\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/damcduff\/\">Daniel McDuff<\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/vitals.cs.washington.edu\/\">Demo link<\/a><\/li>\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/physiological-sensing\/\">Physiological Sensing<\/a> (Project page)<\/li>\n<\/ul>\n<p>*This on-demand webinar features a previously recorded Q&A session and open captioning.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The SARS-CoV-2 (COVID-19) pandemic is transforming the face of healthcare around the world. One example of this transformation can be seen in the number of medical appointments held via teleconference, which has increased by more than an order of magnitude because of stay-at-home orders and greater burdens on healthcare systems. Experts suggest that particular attention [&hellip;]<\/p>\n","protected":false},"featured_media":736801,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"research-area":[13556,13562,13552,13554,13553],"msr-video-type":[],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-736774","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-hardware-devices","msr-research-area-human-computer-interaction","msr-research-area-medical-health-genomics","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/yN1-LRBsvmY","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/736774"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/736774\/revisions"}],"predecessor-version":[{"id":736825,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/736774\/revisions\/736825"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/736801"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=736774"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=736774"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=736774"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=736774"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=736774"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=736774"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}