Video Calling for Autism explores how we might employ cutting edge innovations in computer vision and AI to help make video calling more comfortable to autistic users. Autistic people often have challenges conveying and reading facial expressions during conversations. In video calls, they sometimes have difficulty knowing when their facial expressions are appropriate for the sentiment they wish to convey; when a mismatch occurs, conversations can go badly, potentially misleading or angering their conversation partners. We use technologies from MSR AI to analyze an autistic person\u2019s facial expressions (as seen from the video camera), classify them into basic emotions, and then render this in real time as emojis on their screen. Giving users live feedback in a video call about how their own facial expressions might be interpreted can help them ensure that they are correctly expressing their meaning and improve conversations while using Teams, Skype or other video calling systems.<\/p>\n","protected":false},"excerpt":{"rendered":"
Video Calling for Autism explores how we might employ cutting edge innovations in computer vision and AI to help make video calling more comfortable to autistic users. Autistic people often have challenges conveying and reading facial expressions during conversations. In video calls, they sometimes have difficulty knowing when their facial expressions are appropriate for the […]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13554],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-620142","msr-project","type-msr-project","status-publish","hentry","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2019-01-01","related-publications":[601428],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"guest","display_name":"Annuska Zolyomi","user_id":620154,"people_section":"People","alias":""},{"type":"user_nicename","display_name":"John Tang","user_id":32380,"people_section":"People","alias":"johntang"},{"type":"user_nicename","display_name":"Ed Cutrell","user_id":31490,"people_section":"People","alias":"cutrell"},{"type":"guest","display_name":"Jennifer Frances Waldern","user_id":620151,"people_section":"People","alias":""},{"type":"user_nicename","display_name":"Sean Andrist","user_id":36443,"people_section":"People","alias":"sandrist"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/620142"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":2,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/620142\/revisions"}],"predecessor-version":[{"id":620157,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/620142\/revisions\/620157"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=620142"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=620142"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=620142"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=620142"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=620142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}