{"id":556632,"date":"2018-12-12T08:00:22","date_gmt":"2018-12-12T16:00:22","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=556632"},"modified":"2024-08-13T09:16:28","modified_gmt":"2024-08-13T16:16:28","slug":"soundscaping-the-world-with-amos-miller","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/podcast\/soundscaping-the-world-with-amos-miller\/","title":{"rendered":"Soundscaping the world with Amos Miller"},"content":{"rendered":"\n<figure class=\"wp-block-image aligncenter wp-image-556809 size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-1024x576.png\" alt=\"Product Strategist Amos Miller\" class=\"wp-image-556809\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-1024x576.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-300x169.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-768x432.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-1066x600.png 1066w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-655x368.png 655w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-343x193.png 343w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5.png 1400w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Product Strategist Amos Miller<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"episode-54-december-12-2018\">Episode 54, December 12, 2018<\/h3>\n\n\n\n<p><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/amosm\/\">Amos Miller<\/a> is a product strategist on the Microsoft Research NeXT <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/enable\/\">Enable<\/a> team, and he\u2019s played a pivotal role in bringing some of MSR\u2019s most innovative research to users with disabilities. He also happens to be blind, so he can appreciate, perhaps in ways others can\u2019t, the value of the technologies he works on, like <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/product\/soundscape\/\">Soundscape<\/a>, an app which enhances mobility independence through audio and sound.<\/p>\n\n\n\n<p>On today\u2019s podcast, Amos Miller answers burning questions like how do you make a microwave accessible, what\u2019s the cocktail party effect, and how do you hear a landmark? He also talks about how researchers are exploring the untapped potential of 3D audio in virtual and augmented reality applications, and explains how, in the end, his work is not so much about making technology more accessible, but using technology to make life more accessible.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"related\">Related:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/podcast\">Microsoft Research Podcast<\/a>: View more podcasts on Microsoft.com<\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/itunes.apple.com\/us\/podcast\/microsoft-research-a-podcast\/id1318021537?mt=2\">iTunes<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen to new podcasts each week on iTunes<\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/subscribebyemail.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Email<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen by email<\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/subscribeonandroid.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Android<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Subscribe and listen on Android<\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/open.spotify.com\/show\/4ndjUXyL0hH1FXHgwIiTWU\">Spotify<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Listen on Spotify<\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.blubrry.com\/feeds\/microsoftresearch.xml\">RSS feed<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/note.microsoft.com\/ww-registration-microsoft-research-newsletter-s.html?wt.mc_id=S-webpage_podcast\">Microsoft Research Newsletter<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Sign up to receive the latest news from Microsoft Research<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"episode-transcript\">Episode Transcript<\/h3>\n\n\n\n<p>Amos Miller: Until you are out there in the wind, in the rain, with the people, experiencing, or at least trying to get a sense for the kind of experience they\u2019re going through, you\u2019ll never understand the context in which your technology is going to be used. It\u2019s not something you can imagine, or glean from secondary data, or even from video or anything. Until you are there, seeing how they grapple with issues that they are dealing with, it\u2019s almost impossible to really understand that context.<\/p>\n\n\n\n<p><strong>(music plays)<\/strong><\/p>\n\n\n\n<p><strong>Host: You\u2019re listening to the Microsoft Research Podcast, a show that brings you closer to the cutting-edge of technology research and the scientists behind it. I\u2019m your host, Gretchen Huizinga.<\/strong><\/p>\n\n\n\n<p><strong>Host: Amos Miller is a product strategist on the Microsoft Research NeXT Enable team, and he\u2019s played a pivotal role in bringing some of MSR\u2019s most innovative research to users with disabilities. He also happens to be blind, so he can appreciate, perhaps in ways others can\u2019t, the value of the technologies he works on, like Soundscape, an app which enhances mobility independence through audio and sound.<\/strong><\/p>\n\n\n\n<p><strong>On today\u2019s podcast, Amos Miller answers burning questions like how do you make a microwave accessible, what\u2019s the cocktail party effect, and how do you hear a landmark? He also talks about how researchers are exploring the untapped potential of 3D audio in virtual and augmented reality applications, and explains how, in the end, his work is not so much about making technology more accessible, but using technology to make life more accessible. That and much more on this episode of the Microsoft Research Podcast.<\/strong><\/p>\n\n\n\n<p><strong>Host: Amos Miller, welcome to the podcast.<\/strong><\/p>\n\n\n\n<p>Amos Miller: Thank you. It\u2019s great to be here.<\/p>\n\n\n\n<p><strong>Host: You are unique in the Microsoft Research ecosystem. Your work is mission-driven. Your personal life strongly informs your professional life and, we\u2019ll get more specific in a bit. But for starters, in broad strokes, tell us what gets you up in the morning. Why do you do what you do?<\/strong><\/p>\n\n\n\n<p>Amos Miller: I\u2019ve always been passionate about technology from a very young age. But, really, in the way that it impacts people\u2019s lives. And it\u2019s not a mission that I necessarily knew about when I went through my career and experiences with technology. But when I look back, I see that those are the areas where I could see that a person feels differently about themselves or about the environment as a result of their interaction with that technology. That\u2019s where I thought okay, that is having meaning to this person. And I have this huge, wonderful opportunity to do what I do in Microsoft Research to actually have turned that passion into my day job, which is very\u2026 I feel extremely fortunate with that. And I sometimes have to pinch myself to see that it\u2019s not a dream.<\/p>\n\n\n\n<p><strong>Host: Well, tell us a little bit about your background and how that plays into what you are doing here.<\/strong><\/p>\n\n\n\n<p>Amos Miller: I\u2019m very much a person that grew up in the technology world. I also moved a number countries over my career, and my life. I grew up in Israel. I spent many years in the UK, in London. I spent a few other years in Asia, in Singapore, and now I\u2019m here, so all of these aspects of my life have been very important to me. I also happen to be blind. I suffer from a genetic eye condition called retinitis pigmentosa. It was diagnosed when I was five and I gradually lost my sight. I started university with good enough sight to manage and finish university with a service dog and any kind of technology I could find to help me read the whiteboard, to help me read the text on the computer. And I\u2019d say by the age of 30, I totally stopped using my sight. And that\u2019s when I really started living life as a fully blind person.<\/p>\n\n\n\n<p><strong>Host: Let\u2019s talk about your job for a second. You are a product strategist at Microsoft Research, so how would you describe what you do?<\/strong><\/p>\n\n\n\n<p>Amos Miller: So, I work in a part of the organization at Microsoft Research that looks at really transferring technology ideas into impact. Into a way that they impact business, impact people. A good idea will only have an impact when it\u2019s applied in the right way, in the right environment, so that the social, the business, the technological context in which it operates is going to make it thrive. Otherwise it doesn\u2019t matter how good it is, it\u2019s not going to have an impact.<\/p>\n\n\n\n<p><strong>Host: Right. So, let\u2019s circle over to this previous role you had which was in Microsoft\u2019s Digital Advisory program. And I bring it up in as much as it speaks to how often our previous work can inform our current work, and you referred to that time as your \u201ccustomer-facing life.\u201d How does it inform your role as a strategist today?<\/strong><\/p>\n\n\n\n<p>Amos Miller: What always energizes me is when I see and observe the meaning and the impact that technology can really have for people. And I don\u2019t say it lightly. Until you are out there in the wind, in the rain, with the people, experiencing, or at least trying to get a sense for the kind of experience they are going through, you\u2019ll never understand the context in which your technology is going to be used. It\u2019s not something you can imagine, or glean from secondary data, or even from video or anything. Until you are there, seeing how they grapple with the issues that they are dealing with, it\u2019s almost impossible to really understand that context. And the work that I\u2019ve done in, actually, my first nine years in Microsoft, I worked in a customer-facing part of the business, in the Strategic Advisory Services, today known as the Digital Advisory Services. It\u2019s work that we do with our largest customers around the world to really help them figure out how they can transform their own businesses and leverage advancements in technology.<\/p>\n\n\n\n<p><strong>Host: Right. So now, as you are working in Microsoft Research, as a product strategist, how does that transfer to what you do today?<\/strong><\/p>\n\n\n\n<p>Amos Miller: First of all, I want to introduce, for a moment, the team that I work with, which is the Enable team in Microsoft Research. And the Enable team is looking at technological innovations, especially with disabilities in mind. In our case, our two primary groups are people with ALS and people who are blind. As a product strategist, my role is to work across the research, engineering, marketing and our customer segment and really figure out and understand how we can harness what we have from a technology perspective and, as an organization, to maximize and have that impact that we aspire to have with that community. And that takes a great deal of \u2013 again, going back to my earlier point \u2013 spending time with that community, going out there and spending time, in my case, with other people who are blind because I only know my own experience. I don\u2019t have everybody else\u2019s experience. The only way for me to learn about that is to be out there. And in our team, every developer goes out there to spend time with end users because that\u2019s the only way you can really get under the covers and understand what\u2019s going on.<\/p>\n\n\n\n<p><strong>Host: Right.<\/strong><\/p>\n\n\n\n<p><strong>(music plays)<\/strong><\/p>\n\n\n\n<p><strong>Host: So, the website says you drive a research program that \u201cseeks to understand and invent accessibility in a world\u201d \u2013 this is the fun part \u2013 \u201cwhere AI agents and mixed reality are the primary forms of interaction.\u201d It sounds kind of sci-fi to me\u2026<\/strong><\/p>\n\n\n\n<p>Amos Miller: A little bit. Let me unpack that a little bit. When we traditionally think about accessibility, we think about, how do you make something accessible? So how do you make a microwave more accessible? Well, there isn\u2019t anything inherently inaccessible in putting a piece of pizza and warming it up in the microwave. The only reason it\u2019s inaccessible is because the microwave was designed in an inaccessible way. It could have been accessible from the beginning.<\/p>\n\n\n\n<p><strong>Host: Sure.<\/strong><\/p>\n\n\n\n<p>Amos Miller: But the world we are moving to is, it\u2019s not about me operating the microwave, it\u2019s not about the accessibility of the microwave, it\u2019s about me preparing dinner for my family. That\u2019s the experience that I\u2019m in. And there\u2019s a bunch of technologies that support that experience. And that experience is what I am seeking to make an accessible and inclusive experience.<\/p>\n\n\n\n<p><strong>Host: Okay.<\/strong><\/p>\n\n\n\n<p>Amos Miller: That means that we are no longer talking about the microwave, we are talking about a set of interactions that involve people, that involve technology, that involves physical things in the environment. It\u2019s not about making the technology accessible, it\u2019s about using technology to make life more accessible, whether you are going for a walk with a friend, whether you are going to see a movie with a friend, whether it\u2019s sitting in a meeting and brainstorming a storyboard for video. All of these are experiences, and the goal is, how do you make those experiences accessible experiences? That kind of gets you thinking about accessibility in a very different way, where your interaction is with the person that you are sitting in front of. The technology is just there in support of that interaction.<\/p>\n\n\n\n<p><strong>Host: Right. As I\u2019m researching the interview, I\u2019m find myself thinking of the various solutions \u2013 maybe the \u201ctechnical guide dog\u201d mentality \u2013 like let\u2019s replace all these things, with technology, that people have traditionally used for independence. And the technology as it enters that ecosystem, some people might think the aim is to replace those things, but I don\u2019t think that\u2019s the point of what\u2019s going on here. Am I right?<\/strong><\/p>\n\n\n\n<p>Amos Miller: That\u2019s right. There is a tendency, when you come at a problem with a technology solution, to look at what you are currently doing and replace that with something that\u2019s automatic. Right? Oh, you are using a guide dog? How can I replace that guide dog and give you a robot? So, I work on technology that enhances mobility independence through audio and sound, which we\u2019ll talk about in a minute.<\/p>\n\n\n\n<p><strong>Host: Right.<\/strong><\/p>\n\n\n\n<p>Amos Miller: But often people ask me, how would that work for people who can\u2019t hear? And the natural inclination to them is to say, oh, okay, well you\u2019ll have to deliver the information in a different way. The thing is that people get a sense of their space and their surroundings using the senses that they have. To me, the question is not, how do we shortcut that? It\u2019s how do they sense their space today? They do. They don\u2019t sit there feeling completely disconnected. And if you are going to intervene in that, you better be consistent with how they\u2019re experiencing it today.<\/p>\n\n\n\n<p><strong>Host: Yeah, and that leads me right into the next question because you and I talked earlier about the fundamental role that design plays in the success of human computer interaction. And I\u2019m really eager to have you weigh in on the topic. Let\u2019s frame this broadly in terms of assumptions. And that\u2019s kind of what you were just referring to.<\/strong><\/p>\n\n\n\n<p>Amos Miller: Yeah.<\/p>\n\n\n\n<p><strong>Host: You know, if I\u2019m looking at you and I think, well my solution to how you interact with the world with technology would be Braille, that\u2019s an assumption. So, I\u2019m just going to give you free reign here. Tell us what you want us to know about this from your perspective.<\/strong><\/p>\n\n\n\n<p>Amos Miller: We all make assumptions about other people\u2019s other people\u2019s experience of life. You are referring to Bill Buxton who was on your podcast a few weeks ago.<\/p>\n\n\n\n<p><strong>Host: Right.<\/strong><\/p>\n\n\n\n<p>Amos Miller: And he\u2019s actually been a very close friend and mentor throughout the work that we are doing on Soundscape, which we\u2019ll talk about in a minute. And he\u2019s really brought to our attention that what we\u2019ve done, of going out there and experiencing the real situation that people are experiencing, is about empathy and it\u2019s about trying to understand and probe ideas that challenge your assumptions about what effect they will have. But, really seeing, observing and understanding their experience in that particular situation, and then maybe applying, from your learning, some form of intervention into that experience and observing how that affects that experience. It doesn\u2019t have to be a complete piece of software or technology, it\u2019s just an intervention. It can be completely low-fi. That helps you to start expanding your understanding. And you don\u2019t have to do it with 100 people. Do it with two\u2026 three people. You will discover a whole new world you didn\u2019t know about. I\u2019m sorry, but you don\u2019t need 200 data points to support that experience, you\u2019ve just seen it. And you can build on that. So, can you enhance that, in any way, to give them an even richer awareness of their surrounding? And those are the kind of questions that taking design through that very experiential lens has led us to the work that we are actually doing our work on Soundscape, which is the technology that we\u2019ve been developing over the last few years, to really see how far we can take this notion of how people perceive the world and how you can enhance that so their perception is enhanced.<\/p>\n\n\n\n<p><strong>(music plays)<\/strong><\/p>\n\n\n\n<p><strong>Host: Well, let\u2019s talk about 3D sound and an exciting launch earlier this year in the form of Microsoft\u2019s Soundscape. This is such a cool technology with so many angles to talk about. First, just give our listeners an overview of Soundscape. What is it, who is it for, how does it work, how do people experience it?<\/strong><\/p>\n\n\n\n<p>Amos Miller: Soundscape is a technology that we developed in collaboration with Guide Dogs, certainly in the early stages, and still do. And the idea is very much using audio that\u2019s played in 3D. Using a stereo headset, you can hear the landmarks that are around you and you can, thereby, really enrich your awareness of your surroundings, of what\u2019s where in a very natural, easy way. And that really helps you feel more independent, more confident, to explore the world beyond what you know.<\/p>\n\n\n\n<p><strong>Host: How do you hear a landmark?<\/strong><\/p>\n\n\n\n<p>Amos Miller: How do you hear a landmark? So, for example, if you are standing and Starbucks is in front of you and to the right, we will say the word Starbucks, but we won\u2019t say it\u2019s in front of you and to the right, it will sound like it is over there where Starbucks is.<\/p>\n\n\n\n<p><strong>Host: Oh.<\/strong><\/p>\n\n\n\n<p>Amos Miller: OK? And that\u2019s generated using, the technical term is head rotation transfer of synthetic binaural audio. So, it\u2019s work that actually was developed in Microsoft Research, over a number of years, by Ivan Tashev and his team. And effectively, you can generate sound to make it sound like it\u2019s not in between your ears. You can hear it as though it\u2019s out in the space around you. It\u2019s really quite amazing. And we also use non-audio cues. For example, one of the ideas that we built into Soundscape is this notion of a virtual audio beacon. Not to be confused with Bluetooth beacons! It\u2019s completely virtual. But let\u2019s suppose that you are standing on a street corner and you are heading to a restaurant that\u2019s a block and a half away. What you can do with Soundscape is play some audio beacon that will sound like it\u2019s coming from that restaurant, so no matter which way you\u2019re standing, which way you\u2019re heading, you can always hear that \u201cclick-click\u201d sound so you know exactly where that restaurant is. You can see it with your ears.<\/p>\n\n\n\n<p><strong>Host: How do you do that? How do you place a beacon someplace, technically?<\/strong><\/p>\n\n\n\n<p>Amos Miller: Binaural audio is when you have a slightly different sound in each ear which tricks the brain into having a sense of, that sound is three dimensional. It\u2019s exactly the same way that 3D images work. Audio works almost the same. If Ivan was here, he\u2019ll say it\u2019s not exactly the same, but by generating a slightly different soundwave in each ear, you\u2019re able to make sound, sound like it\u2019s coming from a specific direction. But by playing it in each ear slightly differently, it will actually sound like it\u2019s coming from in front of you and to the right. OK? Now how do we know where to place that beacon?<\/p>\n\n\n\n<p><strong>Host: Right.<\/strong><\/p>\n\n\n\n<p>Amos Miller: At present, we \u2013 it\u2019s largely designed to be used outdoors \u2013 so, we use GPS, so we know where you are standing. We know where that restaurant is, so we have two coordinates to work with. We also estimate which way you are facing. So, if you were facing the restaurant, we would want to play that beacon right in front of you. If you were standing at 90 degrees to the restaurant, we\u2019d want to make that beacon sound like it\u2019s coming not only from your right ear, but 100 meters away to your right.<\/p>\n\n\n\n<p><strong>Host: Unbelievable\u2026<\/strong><\/p>\n\n\n\n<p>Amos Miller: Yeah? And so, taking all of those sensory inputs and taking the information from the map, the GPS location, the direction, we reproduce the sound image in your stereo headset so that you can hear the direction of the sound and where the thing is. And the most amazing thing is, this is all done in real time, completely dynamic. So, as you walk down the street, that restaurant may sound in front of you at 45 degrees to your right, and as you progress, you\u2019ll hear it getting closer and closer and further and further to your right and further and further to your right. And if you overshoot it, it\u2019ll start to sound behind you a little bit, yeah? Now, why is this so important? Because I\u2019m not going to the restaurant on my own. I\u2019m there with my kid or with my wife, or with my friend. And, if I were to hold a phone with the GPS instructions and all of that, I can\u2019t hold a conversation with that person at the same time because I\u2019m so engaged with the technology. And we talked earlier about, how do you get technology to be in the background? That beacon sound is totally in the background. You don\u2019t have to think about it, you don\u2019t have to attend to it mentally, it\u2019s just there. So, you know where the restaurant is, and you continue to have a conversation with the person you are with, or you can daydream, or you can read your emails, listen to a podcast, and all of that happens at the same time. Because it\u2019s played in 3D space, because it\u2019s non-intrusive. You minimize the use of language. And all of these subtle aspects are absolutely crucial for this kind of technology to be relevant to this situation. You\u2019re not sitting in front of the computer and it\u2019s the only thing you are doing. You are outdoors. There\u2019s a ton of things happening all the time that you have to deal with. You can\u2019t expect the person to disassociate themselves from all of that. You know, Soundscape is one way of addressing this very, very interesting and important question. Throughout history, technology has always changed the way that we do things. But I think that we\u2019re starting to see that, as technology developers, we really have to be much more mindful about just from the subtleties of how we design something on, what is the relationship between the technology and the person in that situation? How can a technology do exactly the same as it has done, but do so in a way that makes the person feel empowered and develop a new skill. Great runners learn to feel their heartbeat. But if they have a heart monitor, they\u2019ll stop feeling that heartbeat because the device on their wrist tells them what it is. Well, that\u2019s only because that\u2019s how it was designed. If the heart monitor, instead of telling you, you are at, I don\u2019t know, 150, it\u2019d say, what do you think you\u2019re at? And you\u2019d say, oh, I\u2019m at 140, and it\u2019ll say, oh, you are actually at 150. You will have learned something new from that. It\u2019s exactly the same function, but you have developed yourself as a result of that interaction. And I think that that\u2019s the kind of opportunity that we need to start looking for.<\/p>\n\n\n\n<p><strong>Host: I want to circle back to this 3D audio and the technology behind it, and something that you referred to as \u201cthe cocktail party effect.\u201d Can you explain that a little bit and how Microsoft Research is sort of leading the way here?<\/strong><\/p>\n\n\n\n<p>Amos Miller: The cocktail party effect is an effect, in the world of psycho-acoustics, that is very simple. If you imagine you\u2019re sitting around a table in a cocktail party having a very exciting conversation with somebody, and there are lots of other similar conversations happening around you at the same time, because all of those conversations are happening in 3D space, you are actually able to hear all of those conversations even though you are attending just to yours. You are listening and you can understand and engage in your conversation, but if your name came up in any of those other conversations, you\u2019ll immediately turn your head and say, hey guys, what are you talking about there? And that\u2019s an incredible capability of the brain to manage a very rich set of inputs in the auditory space that is very much under-utilized today in the technology space. We always feel that if we need to convert something into audio, it\u2019s got to be sequenced, because we can only hear one thing at a time. When it\u2019s in 3D, that\u2019s no longer the case. And that\u2019s a huge opportunity. We play a lot of that in VR and augmented reality and we spend a lot of time on the visual aspect of virtual reality and really pushing the envelope on how far we can take the use of immersive experiences in objects in all directions. But the same is available with audio. Even more with audio because your eyes are no longer engaged. Audio is in 360. If we block our ears for a moment, all of a sudden, our awareness level drops. But we are so unaware of the power of audio because vision just takes over everything. And I think the work that we have done, both in the acoustic work on 3D audio, and the application, especially in the disability space where we placed the constraints on the team \u2013 there is no vision, now let\u2019s figure it out \u2013 and that leads to new frontiers of discovery and innovation in this space that I think could be applicable and would be applicable in many other spaces. And that, you know, that heads-up experience when you are out and about in the streets, not focused on the screen, but engaged in your surroundings. And that\u2019s a perfect situation where audio has huge advantages that we can look at.<\/p>\n\n\n\n<p><strong>(music plays)<\/strong><\/p>\n\n\n\n<p><strong>Host: I ask each of my guests some version of the question, what keeps you up at night? Because I\u2019m interested in how researchers are addressing unintended consequences of the work they\u2019re doing. Is there anything that concerns you, Amos? Anything that keeps you up at night?<\/strong><\/p>\n\n\n\n<p>Amos Miller: I think things keeps me up at night because they are so interesting and yet unsolved. You know, we talked a bit about, how do you really express and portray the physical space around you in ways that utilize your other senses and really maximize the ability of the brain to make sense of places without vision? And I really think that, with Soundscape, we\u2019ve only started to scratch the surface of that question. Over half of the brain is devoted to perception. And I think that, when we find ways to really engage, even further engage that incredible human capability, we will discover a whole new frontier of machine and human interaction in ways that we don\u2019t understand today.<\/p>\n\n\n\n<p><strong>Host: You said you arrived at Microsoft Research from \u201cleft field.\u201d What\u2019s your story on how you came to be working on research in accessibility at Microsoft Research?<\/strong><\/p>\n\n\n\n<p>Amos Miller: I started life as a developer, and I did a business degree and joined the Strategic Advisory Services in Microsoft Consulting in the UK. And I think it was a very special moment in Microsoft, over the last few years, when we really started to understand the meaning of impacting every person on the planet with technology and seeing that as our mission. And that led to a series of conversations that opened an opportunity for us to actually get behind that statement and we basically joined Microsoft Research through that mission, through the work that we\u2019re doing in Soundscape. And because we already had very strong relationships, thanks to some wonderful people in the company, and strong relationships here in Microsoft Research and in other parts of the company.<\/p>\n\n\n\n<p><strong>Host: Before we close, Bill Buxton asked me to ask you about the kayak regatta that you organized.<\/strong><\/p>\n\n\n\n<p>Amos Miller: Uh huh. Oh, we didn\u2019t talk about that.<\/p>\n\n\n\n<p><strong>Host: Just tell that story quickly because I do have one question I want to wrap up with before we go.<\/strong><\/p>\n\n\n\n<p>Amos Miller: Okay. Well we talked about Soundscape as a technology that really enables you to hear signals in 3D around you. And that was largely designed to be used in the street, right? And then we thought, what would happen if we placed that audio beacon on a lake? So, we got a bunch of people during the summer hackathon and said, okay, well let\u2019s try it out. So, we organized an event on Lake Sammamish. We hacked Soundscape to work on the lake and placed some virtual audio beacons around the lake and invited a group of people who are blind to come and kayak with us and see how they enjoy it. And they absolutely loved it. And I think that was a real eye-opener for us. You have to understand the difference here, you know? Could they kayak before? Sure, no problem, because a sighted person would be with them and tell them, okay, now you go straight, now you row left\u2026 But I\u2019m sorry, that\u2019s a very boring experience. You are not in control, you are not independent, you are just doing the work. And by being able to hear where those beacons are, you are truly in the driving seat. And that is a sense of independence that we\u2019ve not really seen to that extent before we did this event.<\/p>\n\n\n\n<p><strong>Host: I like how you called it an eye-opening event!<\/strong><\/p>\n\n\n\n<p>Amos Miller: It was!<\/p>\n\n\n\n<p><strong>Host: There are so many metaphors about vision that we just sort of take for granted, right?<\/strong><\/p>\n\n\n\n<p>Amos Miller: Maybe it\u2019s because I have prior sight, maybe not, but I, first of all, I use those metaphors all the time, and I also feel, you know, I could close my eyes and feel that my eyes are closed and open them and feel that they\u2019re open. And I definitely take everything in in a very different way, even though the eyes don\u2019t actually do the scientific aspect of what they\u2019re designed to do.<\/p>\n\n\n\n<p><strong>Host: As we close, I always ask my guests to offer some parting advice to our listeners whether that be in the form of inspiration for future research or challenges that remain to be solved or personal advice on next steps along the career path, whether you have a guide dog with you or Soundscape\u2026 What would you say to your 25-year old self if you were just getting started in this arena?<\/strong><\/p>\n\n\n\n<p>Amos Miller: I honestly would say, get real life experience. Especially in the areas that you are passionate about. Be passionate about them with even more energy and see the work that you do in the context of what you are passionate about. Because you can only really apply your personal experiences to what you do. It\u2019s so great here, in Microsoft Research, to see the interns coming here in the summer. And the creativity and passion, and new perspectives that they bring to our work here. And there\u2019s a little bit of a side of me that worried they\u2019ll jump into the job before they went out and explored the world. And I think it\u2019s important that they find a way to do something that gives them that meaningful context to the work that they\u2019ll be doing here.<\/p>\n\n\n\n<p><strong>(music plays)<\/strong><\/p>\n\n\n\n<p><strong>Host: Amos Miller, thank you for joining us today. It\u2019s been \u2013 can I say it? \u2013 an eye-opening experience!<\/strong><\/p>\n\n\n\n<p>Amos Miller: Sure. My pleasure. Thanks so much for having me.<\/p>\n\n\n\n<p><strong>To learn more about Amos Miller and the latest innovations in audio, sound and accessibility technology, visit Microsoft.com\/research<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Episode 54, December 12, 2018 &#8211; Amos Miller is a product strategist on the Microsoft Research NeXT Enable team, and he\u2019s played a pivotal role in bringing some of MSR\u2019s most innovative research to users with disabilities. He also happens to be blind, so he can appreciate, perhaps in ways others can\u2019t, the value of the technologies he works on, like Soundscape, an app which enhances mobility independence through audio and sound.<\/p>\n","protected":false},"author":37074,"featured_media":556809,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"https:\/\/player.blubrry.com\/id\/40133264\/","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"categories":[240054],"tags":[],"research-area":[13554],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-556632","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-msr-podcast","msr-research-area-human-computer-interaction","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"https:\/\/player.blubrry.com\/id\/40133264\/","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[144928,835063],"related-projects":[605433],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"<img width=\"960\" height=\"540\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5.png\" class=\"img-object-cover\" alt=\"Product Strategist Amos Miller\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5.png 1400w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-300x169.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-768x432.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-1024x576.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-1066x600.png 1066w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-655x368.png 655w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/12\/Amos-Miller_POD_Site_11_2018_1400x788-5c103ec852ed5-343x193.png 343w\" sizes=\"(max-width: 960px) 100vw, 960px\" \/>","byline":"","formattedDate":"December 12, 2018","formattedExcerpt":"Episode 54, December 12, 2018 - Amos Miller is a product strategist on the Microsoft Research NeXT Enable team, and he\u2019s played a pivotal role in bringing some of MSR\u2019s most innovative research to users with disabilities. He also happens to be blind, so he&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/556632"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37074"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=556632"}],"version-history":[{"count":8,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/556632\/revisions"}],"predecessor-version":[{"id":1071534,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/556632\/revisions\/1071534"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/556809"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=556632"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=556632"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=556632"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=556632"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=556632"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=556632"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=556632"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=556632"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=556632"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=556632"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=556632"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}