{"id":954351,"date":"2023-07-12T08:28:49","date_gmt":"2023-07-12T15:28:49","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=954351"},"modified":"2024-01-17T12:27:09","modified_gmt":"2024-01-17T20:27:09","slug":"thinking-beyond-audio-augmenting-headphones-for-everyday-digital-interactions","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/thinking-beyond-audio-augmenting-headphones-for-everyday-digital-interactions\/","title":{"rendered":"Thinking beyond audio: Augmenting headphones for everyday digital interactions"},"content":{"rendered":"\n
\"Microsoft<\/figure>\n\n\n\n

This research was accepted by and received a Best Paper Award during<\/em> <\/em>ACM Designing Interactive Systems (DIS) 2023<\/em> (opens in new tab)<\/span><\/a>, which is dedicated to advancing the field of user-centered system design<\/em><\/em>.<\/strong><\/p>\n\n\n\n

Headphones are traditionally used to provide and manage audio experiences through physical controls and a range of sensors. Nonetheless, these controls and sensors have remained confined to audio input and output functionality, such as adjusting the volume or muting the microphone. Imagine if headphones could transcend their role as mere audio devices. <\/p>\n\n\n\n

Because headphones rank among the most popular wearables in the market, we have an exciting opportunity to expand their capabilities through integrating existing sensors with supplementary ones to enable a wide variety of experiences that go beyond traditional audio control. In our paper, \u201cBeyond Audio: Towards a Design Space of Headphones as a Site for Interaction and Sensing<\/a>,” we share a vision that explores this potential.<\/p>\n\n\n\n

By using sensors such as microphones, proximity sensors, motion sensors, inertial measurement units (IMUs), and LiDARs, headphone designers can explore new avenues of input and interaction. The fact that headphones are worn on a person\u2019s head allows for a wide range of applications, such as following head movements, body postures, and hand gestures. Furthermore, as wearable devices, headphones have the potential to provide wearers with context-rich information and enable more intuitive and immersive interactions with their devices and environment beyond traditional button-based controls.<\/p>\n\n\n\n

<\/div>\n\n\n\n\t
\n\t\t\n\n\t\t

\n\t\tSpotlight: blog post<\/span>\n\t<\/p>\n\t\n\t

\n\t\t\t\t\t\t
\n\t\t\t\t\n\t\t\t\t\t\"GraphRAG\n\t\t\t\t<\/a>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t
\n\n\t\t\t\t\t\t\t\t\t

GraphRAG auto-tuning provides rapid adaptation to new domains<\/h2>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

GraphRAG uses LLM-generated knowledge graphs to substantially improve complex Q&A over retrieval-augmented generation (RAG). Discover automatic tuning of GraphRAG for new datasets, making it more accurate and relevant.<\/p>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t
\n\t\t\t\t\t\t\n\t\t\t\t\t\t\tRead more\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t<\/div>\n\t<\/div>\n\t\n\n\n

Potential scenarios for sensor-enhanced headphones <\/h2>\n\n\n\n

To explore this concept further, we propose augmenting headphones with additional sensors and input widgets. These include: <\/p>\n\n\n\n