Camera-based non-contact health sensing webinar
The SARS-CoV-2 (COVID-19) pandemic is transforming the face of healthcare around the world. One example of this transformation can be seen in the number of medical appointments held via teleconference, which has increased by more than an order of magnitude because of stay-at-home orders and greater burdens on healthcare systems. Experts suggest that particular attention should be given to cardiovascular and pulmonary protection during treatment for COVID-19. However, in most telehealth scenarios physicians lack access to objective measurements of a patient’s condition because of the inability to capture vital signs.
In this webinar, Microsoft Principal Researcher Daniel McDuff and University of Washington PhD student Xin Liu will present an overview of computer vision methods that leverage ordinary webcams to measure physiological signals (for example, peripheral blood flow, heart rate, respiration, and blood oxygenation) without contact with the body. Learn about some examples of state-of-the-art neural models that enable on-device sensing even in resource-constrained settings and understand some of the challenges and exciting research opportunities in this space. This webinar will frame the application of these methods in the context of telehealth; however, non-contact physiological measurement also holds promise in broader health, well-being, and affective computing settings.
Together, you’ll explore:
- The optical and physiological basis for camera-based sensing.
- State-of-the-art, on-device algorithms for fast, scalable, and privacy-preserving measurement.
- Future challenges, open research questions, and opportunities in this space.
Resource list:
- Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (publication)
- MTTS-CAN (Github)
- iPhys-Toolbox (Github)
- Xin Liu
- Daniel McDuff
- Demo link
- Physiological Sensing (Project page)
*This on-demand webinar features a previously recorded Q&A session and open captioning.
Speaker Details
Daniel McDuff is a Principal Researcher at Microsoft Research AI in Redmond, where he works on scalable tools to enable the automated recognition, analysis, and synthesis of human behavior, emotions, and physiology. His work has received nominations and awards from Popular Science, South-by-South-West (SXSW), and The Webby Awards and has been reported in The Times, The New York Times, The Wall Street Journal, BBC News, New Scientist, Scientific American, and Forbes magazine.
Xin Liu is a PhD student in the Paul G. Allen School of Computer Science & Engineering at the University of Washington, Seattle. His research interests lie in the intersection of machine learning, sensing, and healthcare. He received a bachelor’s degree with honors in computer science from the University of Massachusetts Amherst in 2018.
- Date:
- Speakers:
- Daniel McDuff, Xin Liu
- Affiliation:
- Microsoft Research, University of Washington
-
-
Daniel McDuff
Principal Researcher
-
-
Watch Next
-
-
-
Decoding the Human Brain – A Neurosurgeon’s Experience
Speakers:- Pascal Zinn,
- Ivan Tashev
-
Microsoft Research India - who we are.
Speakers:- Kalika Bali,
- Sriram Rajamani,
- Venkat Padmanabhan
-
-
AIMI Symposium 2020 - Session 1: Democratizing Healthcare with AI
Speakers:- Ozan Oktay