{"id":609111,"date":"2019-08-30T00:00:25","date_gmt":"2019-08-30T07:00:25","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=609111"},"modified":"2019-09-17T08:58:03","modified_gmt":"2019-09-17T15:58:03","slug":"efficient-and-perceptually-plausible-3-d-sound-for-virtual-reality","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/efficient-and-perceptually-plausible-3-d-sound-for-virtual-reality\/","title":{"rendered":"Efficient and Perceptually Plausible 3-D Sound For Virtual Reality"},"content":{"rendered":"<p>Due to the high computational cost of rendering 3-D graphics for virtual reality, 3-D sound rendering is typically limited to a small fraction of the total compute power. At the same time, it should be perceptually plausible and enhance the listeners&#8217; sense of presence and immersion. One approach to meet these goals is a parametric representation of spatial sound fields that estimates perceptually relevant aspects in an offline encoding step and efficiently decodes the 3-D sound in real-time. A common parametric model includes the time, level, and direction of arrival of the first sound and early reflections, as well as a description of the late reverberation in terms of its level and decay rate. However, rendering all early reflections would be costly. In this talk, we suggest an end-to-end pipeline for the detection and rendering of perceptually relevant early reflections and evaluate its quality depending on the number of included early reflections.<\/p>\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/09\/Efficient-and-Perceptually-Plausible-3-D-Sound-For-Virtual-Reality-SLIDES.pdf\">[SLIDES]<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Due to the high computational cost of rendering 3-D graphics for virtual reality, 3-D sound rendering is typically limited to a small fraction of the total compute power. At the same time, it should be perceptually plausible and enhance the listeners&#8217; sense of presence and immersion. One approach to meet these goals is a parametric [&hellip;]<\/p>\n","protected":false},"featured_media":609120,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"research-area":[243062,13551,13554],"msr-video-type":[],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-609111","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-audio-acoustics","msr-research-area-graphics-and-multimedia","msr-research-area-human-computer-interaction","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/Xwf3DPZyg8Y","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/609111"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/609111\/revisions"}],"predecessor-version":[{"id":609117,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/609111\/revisions\/609117"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/609120"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=609111"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=609111"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=609111"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=609111"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=609111"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=609111"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}