{"id":479538,"date":"2018-04-18T07:58:12","date_gmt":"2018-04-18T14:58:12","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=479538"},"modified":"2020-04-23T15:17:26","modified_gmt":"2020-04-23T22:17:26","slug":"getting-good-vibes-from-your-computer-with-dr-mary-czerwinski","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/podcast\/getting-good-vibes-from-your-computer-with-dr-mary-czerwinski\/","title":{"rendered":"Getting good VIBEs from your computer with Dr. Mary Czerwinski"},"content":{"rendered":"<div id=\"attachment_479940\" style=\"width: 1010px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-479940\" class=\"wp-image-479940 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodcastMaryCzerwinski_Header2_04_2018_1000x400.jpg\" alt=\"\" width=\"1000\" height=\"400\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodcastMaryCzerwinski_Header2_04_2018_1000x400.jpg 1000w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodcastMaryCzerwinski_Header2_04_2018_1000x400-300x120.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodcastMaryCzerwinski_Header2_04_2018_1000x400-768x307.jpg 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><p id=\"caption-attachment-479940\" class=\"wp-caption-text\">Dr. Mary Czerwinski. Photo courtesy of Maryatt Photography.<\/p><\/div>\n<p><strong>Episode 20, April 18, 2018<\/strong><\/p>\n<p>Emotions are fundamental to human interaction, but in a world where humans are increasingly interacting with AI systems, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/marycz\/\">Dr. Mary Czerwinski<\/a>, Principal Researcher and Research Manager of the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/vibe\/\">Visualization and Interaction for Business and Entertainment<\/a> group at Microsoft Research, believes emotions may be fundamental to our interactions with machines as well. And through her team\u2019s work in affective computing, the quest to bring Artificial Emotional Intelligence \u2013 or AEI \u2013 to our computers may be closer than we think.<\/p>\n<p>Today, Dr. Czerwinski tells us how a cognitive psychologist found her way into the research division of the world\u2019s largest software company, suggests that rather than trying to be productive 24\/7, we should aim for <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/focused-aroused-distractible-temporal-perspective-multitasking-communications\/\">Emotional Homeostasis<\/a> instead, and tells us how, if we do it right, our machines could become a sort of \u201cemotional at-work DJ,\u201d sensing and responding to our emotional states, and helping us to become happier and more productive at the same time.<\/p>\n<p><strong>Related:<\/strong><\/p>\n<ul type=\"disc\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/podcast\">Microsoft Research Podcast<\/a>: Visit our podcast page on Microsoft.com<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/itunes.apple.com\/us\/podcast\/microsoft-research-a-podcast\/id1318021537?mt=2\">iTunes<\/a>: Subscribe and listen to new podcasts each week on iTunes<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/subscribebyemail.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Email<\/a>: Subscribe and listen by email<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/subscribeonandroid.com\/www.blubrry.com\/feeds\/microsoftresearch.xml\">Android<\/a>: Subscribe and listen on Android<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/open.spotify.com\/show\/4ndjUXyL0hH1FXHgwIiTWU\">Spotify<\/a>: Listen on Spotify<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.blubrry.com\/feeds\/microsoftresearch.xml\">RSS feed\u00a0<\/a><\/li>\n<\/ul>\n<hr \/>\n<p><strong>Transcript<\/strong><\/p>\n<p>Mary Czerwinski: We were calling it like a DJ. It\u2019s your emotional at work DJ. So, you know, when you need everything really ramped up and going strong like a DJ knows how to do\u2026 but then when it\u2019s time to calm the crowd down, maybe our software can learn, \u201cOkay, Mary needs to take a break. Mary needs to slow down. Mary needs to go get a glass of water\u2026\u201d<\/p>\n<p><strong>Host: You\u2019re listening to the Microsoft Research Podcast, a show that brings you closer to the cutting edge of technology research and the scientists behind it. I\u2019m your host, Gretchen Huizinga.<\/strong><\/p>\n<p><strong>Emotions are fundamental to human interaction, but in a world where humans are increasingly interacting with AI systems, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/marycz\/\">Dr. Mary Czerwinski<\/a>, Principal Researcher and Research Manager of the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/vibe\/\">Visualization and Interaction for Business and Entertainment group<\/a> at Microsoft Research, believes emotions may be fundamental to our interactions with machines as well. And through her team\u2019s work in affective computing, the quest to bring Artificial Emotional Intelligence \u2013 or AEI \u2013 to our computers may be closer than we think.<\/strong><\/p>\n<p><strong>Today, Dr. Czerwinski tells us how a cognitive psychologist found her way into the research division of the world\u2019s largest software company, suggests that rather than trying to be productive 24\/7, we should aim for Emotional Homeostasis instead, and tells us how, if we do it right, our machines could become a sort of \u201cemotional at-work DJ,\u201d sensing and responding to our emotional states, and helping us to become happier and more productive at the same time.<\/strong><\/p>\n<p><strong>That and much more on this episode of the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/category\/podcast\/\">Microsoft Research Podcast<\/a>.<\/strong><\/p>\n<p><strong>Host: Mary Czerwinski welcome to the podcast with today, it\u2019s great to have you with us.<\/strong><\/p>\n<p>Mary Czerwinski: Thank you, it\u2019s an honor to be here.<\/p>\n<p><strong>Host: So, you work under the larger umbrella of <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/human-computer-interaction\/\">Human Computer Interaction<\/a> at Microsoft Research, but more specifically, you\u2019re the Principle Researcher and the Research Manager of the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/vibe\/\">VIBE<\/a> Group.<\/strong><\/p>\n<p>Mary Czerwinski: Right.<\/p>\n<p><strong>Host: Tell us what VIBE stands for and what gets people in your group up in the morning.<\/strong><\/p>\n<p>Mary Czerwinski: VIBE stands for Visualization and Interaction for Business and Entertainment. Most of the people in the group are very deeply into various aspects of information visualization, so helping people work with big data better. We\u2019re building tools for programmers, so programmers can deal with all the vast amounts of data we have coming in these days. Or in the area of affective computing, which is where I\u2019m squarely putting my research these days.<\/p>\n<p><strong>Host: Microsoft Research has a number of social science researchers now.<\/strong><\/p>\n<p>Mary Czerwinski: Yes.<\/p>\n<p><strong>Host: But you actually were the first social science researcher. How did you end up here? Did they come looking for you? Um, who decided they needed a PhD in Cognitive Psychology to help with computer science research?<\/strong><\/p>\n<p>Mary Czerwinski: That\u2019s a great question. I took the initiative to meet with Dan Ling who was managing all of research at that time and talked to him about social science and the benefits of having social scientists on the research teams. But it was actually Eric Horvitz and George Robertson that actually sought me out as a psychologist to partner with them in the research around attention and rendering on the screen and redesigning Windows in 3D, and so the two of them really kind of helped usher me over to Research. I was actually in Product at the time. So, I was in Microsoft, just wasn\u2019t in the Research group. So, it was a great time to come out into the field as a cognitive psychologist because back then, we had one computer screen and it was all about users being able to look at the screen and make sense of it. Well, that\u2019s what cognitive psychologists study, perception and cognition around information, learning, memory, making decisions, attending to various aspects of the displays. So, it was perfect timing for me to put what I did my PhD in, to work for Microsoft.<\/p>\n<p><strong>Host: You know, I would have not even gone there in terms of that thinking, just given where we are today with the attention economy they are calling it\u2026<\/strong><\/p>\n<p>Mary Czerwinski: Yes. Yes.<\/p>\n<p><strong>Host: And there\u2019s so many more demands on our attention. So, tell me how it\u2019s evolved since when you started, to now.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah. Yeah, well, I mean back then, the experiments we would do for instance, with the astronauts at Johnson Space Center, I would be looking at their layouts of their displays and they\u2019d be running nine experiments at a time and they had to monitor them all the time, in addition to the various space station systems like thermonuclear control, which is kind of important. And so, we looked character-based user interfaces and how people can track that kind of information. That all changed when graphical user interfaces came along. And then it was more about how you grouped things, and how you arranged them on the screen, and it\u2019s still about that today, that hasn\u2019t gone away. But now, you know, everything is more social and now we have multiple devices and multiple displays we have to look at. So, it\u2019s just fanned our attention out even more broadly. And harder to control, obviously.<\/p>\n<p><strong>Host: Yeah, so makes your job a little harder as well.<\/strong><\/p>\n<p>Mary Czerwinski: It does, yes.<\/p>\n<p><strong>Host: But that\u2019s exciting.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah, it\u2019s really fun.<\/p>\n<p><strong>Host: Your research focuses on a couple of big ideas: emotion tracking, information worker task management, and healthcare and wellness for individuals and groups. And we\u2019ll get to each of those in turn.<\/strong><\/p>\n<p>Mary Czerwinski: Okay.<\/p>\n<p><strong>Host: But for starters, let\u2019s talk a little bit about this big idea of Affective Computing and the quest for Artificial Emotional Intelligence, or AEI. What is it and why is it important?<\/strong><\/p>\n<p>Mary Czerwinski: Well, I don\u2019t think we\u2019ll actually have quite natural user interfaces until we can actually talk to our systems the way you and I naturally talk to each other. And so, a large part of that is these really natural, almost automatic, social signals that we cue off of each other. So, the way you\u2019re nodding your head gently in agreement with me is a way that I know that you\u2019re mimicking me, basically, and my thoughts.<\/p>\n<p><strong>Host: Right.<\/strong><\/p>\n<p>Mary Czerwinski: So, we believe that systems will need to have that kind of emotional intelligence, EQ, in order for them to be natural enough for us to really engage with them and want to keep engaging with them, so there\u2019s not that freaky uncanny valley where it just doesn\u2019t feel natural, it doesn\u2019t feel right. So, we\u2019ve been pursuing this emotion tracking in order to track your emotion as a user, so that the system can respond more like a human would, um, emotionally, appropriately.<\/p>\n<p><strong>Host: So, do you think we\u2019ll ever get real artificial emotional intelligence with a machine?<\/strong><\/p>\n<p>Mary Czerwinski: Well, that\u2019s TBD. I would rather be on the edge exploring those things as they happen, as a scientist, and trying to make the most of it.<\/p>\n<p><strong>Host: Part of your research involves designing what you call \u201cdelightful systems\u201d but it isn\u2019t always easy to tell whether they are really delightful or not. How are you tackling this, Mary?<\/strong><\/p>\n<p>Mary Czerwinski: I like to say, \u201cHow can we say that we\u2019re designing systems that delight our users if we don\u2019t actually know?\u201d So that is why we are using cameras and microphones to look at our users faces to see what their facial gestures are. Are they smiling, are they squinting their eyes, are they frowning? But also listen to their voices. Hear how they are saying things about working with our systems. And if we can build these kinds of emotion-sensing platforms into our all our products, then we\u2019ll know from the get-go if we\u2019re actually designing, uh, systems and tools that users are delighted by. Or are they frustrated? And then we should fix those areas that seem on to bring on the frustration. So, I think if you build these tools in to the platform of all of our systems that we build in the future, we\u2019ll know better if we\u2019re making, you know, systems and software that people love.<\/p>\n<p><strong>Host: You were part of a recorded presentation called, \u201cAnd how does that make you feel?\u201d Which I loved the name of\u2026<\/strong><\/p>\n<p>Mary Czerwinski: Yes.<\/p>\n<p><strong>Host: You know it\u2019s like the psychiatrist: how does that make you feel\u2026<\/strong><\/p>\n<p>Mary Czerwinski: Yes, exactly.<\/p>\n<p><strong>Host: And at several points you got frustrated with the fact that your video wouldn\u2019t play. And about the third time, you actually flashed a big smile and go, \u201cThat\u2019s just great!\u201d And I remember thinking, how would I, as a machine, know that you weren\u2019t really happy and delighted with me?<\/strong><\/p>\n<p>Mary Czerwinski: That\u2019s a great question. That\u2019s a great question. Because we never think \u2013 now I\u2019m channeling Daniel McDuff on my team \u2013 we never believe that a one- to ten-second slice of a user\u2019s face is going to give us anything worthwhile. What we believe in is that you have watch and listen to this user for a long time, longitudinally, so that we really understand the range of a person\u2019s emotions. People are all over the place with how labile their emotional state is. I\u2019m pretty up and down. I have a broad range, um, but some people aren\u2019t. Some people are much, you know, flatter or just more controlled with their emotions. And so, you really do have to study an individual for a long time before you know. But then also, the machine needs context about what you\u2019re doing. So, if the machine had been watching and seeing I couldn\u2019t play my video, the machine would learn that that smile is probably a smile of complete frustration, right?<\/p>\n<p><strong>Host: Or a grimace.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah, or a grimace, a grimacing smile it could have been. But yeah, so the machine needs the context and the longitudinal data about you, yourself, as a person, before it can have really good assuredness in that it\u2019s making the right emotional classification.<\/p>\n<p><strong>Host: So that\u2019s an interesting thread to drill in on. Because you want to build a system that will work for many people, not just one person. And if my emotional ups and downs are different than hers then how are you going to bring the research together and make a machine that can tell a difference, if you need to track me for a long time and him for a long\u2026 you know, times a million.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah, well, because you can do this now with simple webcam and mic on any laptop or PC. It\u2019s pretty easy, and the user doesn\u2019t have to do anything to do this kind of tracking longitudinally. And we\u2019re doing right now here in Building 99. Many of us are getting our emotions classified while we\u2019re using everyday software systems and doing our regular work. So now, we have thousands and thousands of hours of these emotions tracked and we can bring them back to bear\u2026 Not only with generalized models, but also personalized models that could be more relevant just to me. So, we can do both scales quite well.<\/p>\n<p><strong>Host: Okay, so you could even employ machine-learning \u2013 AI \u2013 to actually customize in a particular product for a particular person\u2026<\/strong><\/p>\n<p>MaryCzerwinski: Correct, yes. Yes, that\u2019s the angle.<\/p>\n<p><strong>Host: That would be cool\u2026<\/strong><\/p>\n<p>MaryCzerwinski: Mmm hmmm.<\/p>\n<p><strong>(music plays)<\/strong><\/p>\n<p><strong>Host: You framed some of your research in the category of productivity tools. Tell us about the technology you\u2019re working on to help mitigate negative interruptions, multitasking\u2026 or, I think you really would call it task switching, because there is no such thing\u2026<\/strong><\/p>\n<p>Mary Czerwinski: Right.<\/p>\n<p><strong>Host: At least that is what I tell my daughter\u2026 \u201cYou\u2019re not multitasking.\u201d Um. And some of the general lack of focus that we experience at work and if we\u2019re honest, in life.<\/strong><\/p>\n<p>Mary Czerwinski: Yes. You know, I do a lot of work with Shamsi Iqbal and Gloria Mark. And Gloria has really opened my eyes to the fact that everybody has a really different personality. Some people, it turns out, are quite adept at managing their workflow. So, they stay pretty concentrated and focused for longer periods of time than other people. And they take breaks when they know that they need to, when they need to refresh because no one can stay focused 24\/7, that\u2019s a myth. So, we like to refer to something called Emotional Homeostasis, which is, you stay focused, you work hard, maybe you are even a little stressed. And then you do something to balance that out, right? So maybe you use social media, if you\u2019re one of those people. But other people have a harder time staying focused for longer periods of time. And actually, every time they hear a ping, or every time they get an email notification, they go to it. The little numbers on the icons are the worst thing for these kinds of people, because they see they have something new and they have to go check it. So\u2026<\/p>\n<p><strong>Host: Me.<\/strong><\/p>\n<p>Mary Czerwinski: \u2026for those kinds of people, we can actually use machine learning, and this personalized kind of software we\u2019ve been talking about, to see when you need to be in the flow, to see when you actually do your best work, and to kind of help you stay there. So perhaps that\u2019s the time \u2013 when you\u2019re really starting to get into your work \u2013 perhaps that\u2019s the time we turn off notifications or hold less high-priority notifications away from you. Turn off that inbox, you know, dinger, and let you focus. We might even turn off social media if we go so far. The user gives us permission to do that. We\u2019ll do whatever the user wants us to do to keep them in the zone. And then, you know, when you tend to kind of come out of that flow \u2013 maybe it\u2019s right before lunch \u2013 let it all flow back in and it will be just fine!<\/p>\n<p><strong>Host: And the machine can see that you\u2019re moving out of the zone and it\u2019s going to turn back on automatically?<\/strong><\/p>\n<p>Mary Czerwinski: This is current research we\u2019re doing right now. This is our hypothesis, that we\u2019ll be able to see when you prefer to have your hardcore work moments, and when you are okay with letting notifications through and possible work breaks through. Or we can see if you\u2019re one of those people that stays really focused. Maybe we can see you\u2019ve been focused a little too long for yourself. Maybe you are getting a little stressed out, and a little walk would be quite welcome at that point. But it\u2019s all work that\u2019s in progress. So, we still don\u2019t know how these ebb\u2026 we kind of like, we were calling it like a DJ. It\u2019s your emotional at work DJ. So, you know, when you need everything really ramped up and going strong like a DJ knows how to do\u2026 but then when it\u2019s time to calm the crowd down, maybe our software can learn, \u201cOkay, Mary needs to take a break. Mary needs to slow down. Mary needs to go get a glass of water.\u201d Bio break. Something, you know. So, we\u2019ll see how much users will be welcoming such software, and we\u2019ll design it until they do welcome it. We\u2019ll iterate it and do it better.<\/p>\n<p><strong>Host: If we\u2019re using these tools to get in the zone and stay there, should we call it artificial productivity?<\/strong><\/p>\n<p>Mary Czerwinski: No, it\u2019s real productivity.<\/p>\n<p><strong>Host: I\u2019m kidding.<\/strong><\/p>\n<p>Mary Czerwinski: It\u2019s artificially assisted.<\/p>\n<p><strong>Host: Artificially assisted productivity.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah. Yeah.<\/p>\n<p><strong>Host: Well, so let me ask you this, as a psychologist, what happened to good old-fashioned self-discipline? Have we just lost that in this digital world?<\/strong><\/p>\n<p>Mary Czerwinski: Well, I will tell you, in a study we ran two summers ago, a couple of our participants, we turned off all their social media, all their notifications. They weren\u2019t allowed to use their phone for eight hours a day. And a couple of our participants did make note of the fact that they had lost sight of how often they were going to social media and checking their phones and they were shocked by how much more time they had. So, in some sense, the sad truth is yes, we have trained our self to do this task-switching on an almost constant basis. And on a great note, software can help. So, you know, maybe we can train it back!<\/p>\n<p><strong>Host: Let\u2019s get a little meta on that topic and this whole concept of digital assistants and affective agents. And kind of on the same note, have we really reached the point where we need technology to save us from our technology?<\/strong><\/p>\n<p>Mary Czerwinski: I just did a press interview yesterday where I did actually make the claim that we need technology to help us from our technology, so I can stand by that. I\u2019ve said that. But as I said, all of our task-switching \u201cbad\u201d behavior was trained. It was trained by the tools and the features that we asked software companies to build for us, or tech companies in general. So, we can use the technology to retrain ourselves to focus. I believe we can. I know we can. The research shows we can. And we\u2019ll make better decisions. We\u2019ll do better at our jobs. And we\u2019ll be more productive. So yes, if we have to start using technology as training wheels to get rid of all the bad technology that\u2019s, you know, bifurcating and dividing our attention, um, I don\u2019t think that\u2019s a bad thing. I think it\u2019s a good thing. We\u2019ve come around full circle.<\/p>\n<p><strong>Host: From a psychological point of view, aren\u2019t we at the risk of outsourcing some basic human skill sets that are emotional\u2026 that are necessary for emotional growth and health?<\/strong><\/p>\n<p>Mary Czerwinski: Right. So, I wouldn\u2019t say that we\u2019ve gone that far, but it is nice that we can use the machine intelligence to kind of protect us again and get us back into focus. I think that\u2019s going to be great. In terms of the emotional side of things, I really do think that the advent of robots taking care of children and the elderly, it\u2019s almost upon us. That is an outsourcing, in my personal opinion. Possibility a necessary one, but it\u2019s still an outsourcing. And so, that\u2019s why I\u2019m really, really vehemently opposed to not studying what the effects of children using robots and personal assistants is on their own communication, growth, and behavior. But also, I\u2019m really adamant that machines need to have EQ. Not because I don\u2019t want you to know that working with a machine or a robot. But because I want that conversation to have an emotional balance and to be emotionally mature so that kids don\u2019t grow up with this imbalance, with lack of EQ, lack of real intelligence.<\/p>\n<p><strong>Host: Right.<\/strong><\/p>\n<p>Mary Czerwinski: So, I think it goes both ways and that\u2019s why I want to study both of those aspects of it because it could be worrisome, right?<\/p>\n<p><strong>Host: Absolutely. So, on that thread, affective computing, as I\u2019m looking at it, seems to have two sides to it. One is designing machines that can interpret human emotional states and adapt to them. And the other is designing machines that can help humans interpret their own emotional states. First, am I right? And second, if so, why is this two-sided approach necessary and happening?<\/strong><\/p>\n<p>Mary Czerwinski: Most people aren\u2019t actually very aware of their emotional state. And so, what we find when we first start doing our experiments, is it actually takes people a day or two to actually start understanding how they actually feel. I\u2019m usually in the positive quadrant of how we do these self-ratings. And it took me even a little while to realize, I\u2019m not always, you know, happy and high energy, right? Sometimes I am kind of low energy. Sometimes I am sad. So, after you track yourself for a while, and you are honest with yourself, then you start to realize how the states move around. And so, in any experiment, we always know that at the very beginning, users might not be super good at it, but they\u2019ll get better at it over time. And I think that it is very useful because we forget our emotional states very, very quickly. A quick little survey we did showed people forget how they were feeling in about a day. And if it\u2019s a really big event that happened in your life, you\u2019re probably going to remember how you felt. But it\u2019s those little patterns of \u201cmicro-badness\u201d and \u201cmicro-goodness\u201d we don\u2019t actually pay that much attention to, and it could really help us make better decisions. Like for instance, people were telling us after like a week of tracking themselves and whatnot that they wouldn\u2019t remember these things a year from now. So, having a system that tracked it would be quite useful. Now, it has to track it accurately. So, there should be a way that you can correct the system when it\u2019s wrong. But I think it\u2019s kind of nice to go back and look at how I was feeling. And actually, I\u2019m always surprised that am happier most of the time, you know. And frustrated very little of the time, but there are moments you would forget otherwise, so it\u2019s useful to you. It might be useful if you were taking care of a loved one, to be able to see those tracks. Right now, most people go to a therapist\u2019s office or a doctor\u2019s office they fill out a paper form for how they\u2019ve been feeling the last four weeks. Well, people don\u2019t remember how they were feeling the last four weeks. So, um, these tools can be very useful if they could be shared with loved ones and caregivers.<\/p>\n<p><strong>Host: Yeah, so let me ask a question about that, if I\u2019m going to be monitored, in all these situations, what\u2019s watching me? What\u2019s recording\u2026 What I want to know is, I\u2019m in front of my computer right now.<\/strong><\/p>\n<p>Mary Czerwinski: Okay.<\/p>\n<p><strong>Host: And it\u2019s a laptop and I might be working at a desktop at my desk. But out in the wild, I don\u2019t have these devices.<\/strong><\/p>\n<p>Mary Czerwinski: Oh, right no you would have to have some device that has a camera and\/or a mic, but you can have either one.<\/p>\n<p><strong>Host: Okay.<\/strong><\/p>\n<p>Mary Czerwinski: That\u2019s constantly listening to you in those particular contexts that you might want it to. Right now, it\u2019s very easy when people are just at their desk or in a meeting.<\/p>\n<p><strong>Host: Right.<\/strong><\/p>\n<p>Mary Czerwinski: So, actually, we\u2019re tackling meetings next which will be fascinating.<\/p>\n<p><strong>Host: Oh, wow.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah\u2026But yeah, you would have to have some kind of recording device on you if you wanted to get it 24\/7 all day long.<\/p>\n<p><strong>Host: Well, let\u2019s talk about that for a second, and then we\u2019ll swing back to some other topics. Increasingly, the mechanisms that are collecting data include video, audio, maybe wearables, ingestibles, implantables, lunchables\u2026 I don\u2019t know. How do we reconcile the desire to have this knowledge, this quantified-self, this self-awareness, with our desire for privacy and our fear of big brother?<\/strong><\/p>\n<p>Mary Czerwinski: Right, no that\u2019s why we do everything we can to keep your signal private to you. There\u2019s no indefinable information that goes into the Cloud at all. We, as researchers, can\u2019t go in and look at your data if you\u2019re running our system. We can\u2019t.<\/p>\n<p><strong>Host: And so, is it encrypted? I mean, how would I be confident?<\/strong><\/p>\n<p>Mary Czerwinski: You are completely de-identifiable. We can\u2019t find you unless you give us a code back, you know, your ID, and tell us you want your data, which of course we can give you, if you want it. But that\u2019s the only way we know who you are.<\/p>\n<p><strong>Host: Well, I just interviewed Kristin Lauter, who works in cryptography.<\/strong><\/p>\n<p>Mary Czerwinski: Right.<\/p>\n<p><strong>Host: And it\u2019s like all of the different teams that come together to make these tools both fantastic and trustworthy at the same time, is super important.<\/strong><\/p>\n<p>Mary Czerwinski: And we will surely use her stuff. We work with Ronnie, on her team, so he talks to me about what they\u2019re doing all the time.<\/p>\n<p><strong>Host: Oh, good.<\/strong><\/p>\n<p>Mary Czerwinski: It will be a good thing to have.<\/p>\n<p><strong>Host: Yeah. In fact, you used a funny phrase to frame the Human Computer Interaction Group\u2019s relationship to other groups at Microsoft. Tell us what it is and why you say it.<\/strong><\/p>\n<p>Mary Czerwinski: Yeah, human computer interaction people often play glue between various technology teams because we\u2019re usually the user-facing part of the experiment. And we can see when, you know, there\u2019s a technology that\u2019s very right to present to a user but it needs something. Like, we were just talking about. It needs encrypted privacy. So, we\u2019ll bring the two teams that need to talk to each other together because we go out and put our user-interfaces on all of their technologies so we kind of know what they\u2019re doing. So that\u2019s why I say that.<\/p>\n<p><strong>Host: Sure. So, tell me what is going on in the research stage and even in the product stage on things that can help me track my emotions or my state-of-being at work?<\/strong><\/p>\n<p>Mary Czerwinski: What we do know is that users really could use help from our technology to turn off notifications, to possibly turn off non-work-related websites like social media, and help the user focus. And maybe the user just wants to say something like, \u201cI just want to turn all that off for a half hour. Then I\u2019ll be fine.\u201d And the system should help them do that. Eventually the goal would be to do that automatically for the user, so the user doesn\u2019t have to remember to do something manually, on their own.<\/p>\n<p><strong>Host: Right. Hmmm. That\u2019s an interesting thing\u2026 I don\u2019t know if it\u2019s better if I develop the skill to remember to turn it off or to have somebody do it for me.<\/strong><\/p>\n<p>Mary Czerwinski: Right, we have to do studies on all of this.<\/p>\n<p><strong>Host: Right.<\/strong><\/p>\n<p>Mary Czerwinski: Right.<\/p>\n<p><strong>(music plays)<\/strong><\/p>\n<p><strong>Host: One of the biggest problems I have \u2013 and I know is I\u2019m not alone \u2013 is wrangling and making sense of my data. How are you helping me?<\/strong><\/p>\n<p>Mary Czerwinski: Ahhh! Well, I know you did a podcast of <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/visualizing-data-big-ideas-dr-steven-drucker\/\">Steven Drucker<\/a>.<\/p>\n<p><strong>Host: I did. He was so cool.<\/strong><\/p>\n<p>Mary Czerwinski: So, he\u2019s one of the people at our group that does wonderful work in information visualization. But we have many researchers that do work in information visualization at Microsoft Research. And they\u2019re all fabulous. They all take different aspects of how you look at your data. Some of them like to work with networked data. Some of them like to work with time-based data. So, there are many, many tools in the \u201cinfo vis\u201d community \u2013 info vis stands for information visualization.<\/p>\n<p><strong>Host: Thank you.<\/strong><\/p>\n<p>Mary Czerwinski: You\u2019re welcome\u2026 that can be thrown at these kinds of big data problems. Another thing that <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/danyelf\/\">Danyel Fisher<\/a> has done in our group, which I thought was really nice, is he starts to show you your data as it\u2019s coming in. But if there is, so much data that it can\u2019t be all rendered at once, it just gives you a feel for what the data is going to look like, and you decide when you think you have enough to make a decision. So, they are all working with these kinds of interactive visualization tools to help you see patterns in your data that you might not have been able to see, you know, in an Excel spreadsheet, using standard bar graphs or line graphs.<\/p>\n<p><strong>Host: So, you said, um, some of this still in the research stage, but some of it\u2019s already incorporated into BI, and Excel, and things like that.<\/strong><\/p>\n<p>Mary Czerwinski: Yes. Power BI has been a great vehicle for taking visualization work and exposing it to end-users and I think it\u2019s been very helpful. It\u2019s very hard to come up novel visualizations, so it takes a lot of creativity, a lot of work, to cook up something that people can use pretty quickly because they\u2019re usually pretty sophisticated, versus the standard bar chart or pie chart. So, it does take users a little while to learn how to use them, but then when they do they are very powerful and useful.<\/p>\n<p><strong>Host: Yeah, yeah. Let\u2019s look to the future for a second. Your group is publishing prolifically. You\u2019re going to CHI in bit, with a lot of papers. What excites you most about what the field is doing right now and what might be exciting to the next generation of human computer interaction scholars?<\/strong><\/p>\n<p>Mary Czerwinski: Right. Well, I think the whole movement towards the gig economy is really new and exciting and it\u2019s studied pretty hard at CHI. It\u2019s represented pretty well at CHI. So, I tend to go into two tracks when I\u2019m at CHI because there are like 14 parallel tracks, so you have to pick. And I tend to go into mental health and e-health. And then I try to go to the gig economy tracks because that world is moving so fast. So, the advent of micro-tasks are emerging\u2026 you know, even, just think of writing a Word document now. We have researchers in the building who are working on just taking little parts of writing that document and making it a task for somebody to do out there, right?<\/p>\n<p><strong>Host: Jamie Teevan and I did a whole a podcast on this.<\/strong><\/p>\n<p>Mary Czerwinski: <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/snippets-revolution-interview-dr-jaime-teevan\/\">Jamie Teevan<\/a>, OK, good. And <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/shamsi\/\">Shamsi Iqbal<\/a> is doing it as well as some others. But that economy, whether you\u2019re talking about taxi drivers to airplane designers, that economy is going gig. And so, it is just fascinating to listen, to hear the research they\u2019re doing and the trends that are happening, and how those gig workers actually work with each other to make sure each other succeed and they make a good wage. So, to me, I always follow those two tracks and I think the young guns will need to do a lot of work on the gig economy.<\/p>\n<p><strong>Host: Right.<\/strong><\/p>\n<p>Mary Czerwinski: So that\u2019s exciting, but also health and mental health, I mean really moving fast and using machine learning to look at, you know, precision psychology, for instance is a huge topic. So, I\u2019m hoping the young people look at those two areas, but there are many more very hot areas, those are just my two favorite.<\/p>\n<p><strong>Host: We talked about what gets you up in the morning. Is there anything, particularly, that keeps you up at night, Mary?<\/strong><\/p>\n<p>Mary Czerwinski: Yes, I do get worried about our systems that will eventually have good EQ, but they don\u2019t yet. And how working with the systems today when they are not truly intelligent, they don\u2019t filter by age, gender, location, etcetera, in terms of what they say pretty much these days. I worry that it changes people\u2019s communication patterns because they are going to pattern off the system. So, I really get worried, in particular, about young people. The elderly\u2026 I image their morals are already built in and they learned their communication style pretty well by now, but I really worry about the young generation, and the generation that maybe, as we said, maybe they\u2019re going to be working more with a robot than they are with, you know, a teaching assistant in the future. So, I want to make sure that that modeling is what we, as a society, see as appropriate, moral, and positive. So, I really want to focus on generational issues like that. And also, what is the appropriate EQ for machine, right? Do you want to know that it\u2019s not human? I think most of us want to know that it\u2019s not human. And so, how do you do that, and yet still make the conversation feel natural and make the conversation feel appropriate?<\/p>\n<p><strong>Host: That question is so profound because what much of the work happening here is about is making computers more human-like, and yet when you asked that question, \u201cDo you want to know?\u201d I\u2019m nodding my head really hard. Yes, I want to know it\u2019s not\u2026 I don\u2019t want to be fooled by the Turing Test.<\/strong><\/p>\n<p>Mary Czerwinski: Right. Right. So, we have to, again, as a society come up with a plan, basically.<\/p>\n<p><strong>Host: Hmmm. You doing that?<\/strong><\/p>\n<p>Mary Czerwinski: Thinking about it hard.<\/p>\n<p><strong>Host: If you weren\u2019t a researcher, what would you be?<\/strong><\/p>\n<p>Mary Czerwinski: I really wanted to go back and get my PhD in bio-psychology at one point. I\u2026 you know\u2026 I can\u2019t not be a researcher. I\u2019m sorry!<\/p>\n<p><strong>Host: I was just going to say, you answered that by saying, \u201cI\u2019d be a different kind of researcher.\u201d<\/strong><\/p>\n<p>Mary Czerwinski: I mean if I would be a professional tennis player I\u2019d do it, but I don\u2019t have the talent, so it\u2019s not going to happen.<\/p>\n<p><strong>Host: Last question. What advice would you give to your 25-year-old self?<\/strong><\/p>\n<p>Mary Czerwinski: Mmm&#8230;<\/p>\n<p><strong>Host: This is for the researchers out there who would be looking at, \u201cWhat do I do? Where do I put my time, talent, treasure?\u201d<\/strong><\/p>\n<p>Mary Czerwinski: Yeah, what I tend to tell young people that I mentor that are still in graduate school, for instance, because that\u2019s about 25. I tell them not to think that life is just a straight line, right? It\u2019s never a straight line. You don\u2019t get your PhD and go from point A to point B to point C to point D. Sometimes, if you stay in academia, that can happen, but even then, I don\u2019t think your career is going to go in a straight line. Too much happens. And in my particular case, technology changes way too fast, so you always have to be open to something. I thought for sure I was going to go into academia. I couldn\u2019t, because of a two-body problem. I ended up in industry. Oh, my god, was that the best thing for me ever. That was just perfect. And then I jumped around, right? I went to Johnson Space Center. I went to Bell Communications Research. I kept my foot in academia, because I thought, you know, someday, I might want to teach again. Got this wonderful job at Compaq. Which led me to Microsoft. Which led me to Microsoft Research. You know, you just got to stay open, and you\u2019ll know when it\u2019s time to leave\u2026 things won\u2019t feel right. And then that great opportunity might be out there and just be open to it.<\/p>\n<p><strong>(music plays)<\/strong><\/p>\n<p><strong>Host: Mary Czerwinski, thanks for joining us today.<\/strong><\/p>\n<p>Mary Czerwinski: Thank you.<\/p>\n<p><strong>Host: And sharing so much about, what you\u2019re doing, and we can\u2019t wait to see what is going to happen.<\/strong><\/p>\n<p>Mary Czerwinski: Thank you it was my pleasure.<\/p>\n<p><strong>Host: To learn more about Dr. Mary Czerwinski, and how to have a better relationship with your computer, visit <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/\">Microsoft.com\/research<\/a>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Episode 20, April 18, 2018 &#8211; In a world where humans are increasingly interacting with AI systems, Dr. Mary Czerwinski, Principal Researcher and Research Manager at Microsoft Research, believes emotions may be fundamental to our interactions with machines. And through her team\u2019s work in affective computing, the quest to bring Artificial Emotional Intelligence \u2013 or AEI \u2013 to our computers may be closer than we think.<\/p>\n","protected":false},"author":37074,"featured_media":480324,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"https:\/\/player.blubrry.com\/id\/33266545","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"categories":[240054],"tags":[],"research-area":[13554,13553,13559],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-479538","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-msr-podcast","msr-research-area-human-computer-interaction","msr-research-area-medical-health-genomics","msr-research-area-social-sciences","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"https:\/\/player.blubrry.com\/id\/33266545","podcast_episode":"","msr_research_lab":[199565],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[916890,144794,371909,392534,578422,669339],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"<img width=\"480\" height=\"280\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodMaryCzerwinski_Carousel_04_2018_480x280.jpg\" class=\"img-object-cover\" alt=\"\" decoding=\"async\" loading=\"lazy\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodMaryCzerwinski_Carousel_04_2018_480x280.jpg 480w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2018\/04\/PodMaryCzerwinski_Carousel_04_2018_480x280-300x175.jpg 300w\" sizes=\"(max-width: 480px) 100vw, 480px\" \/>","byline":"","formattedDate":"April 18, 2018","formattedExcerpt":"Episode 20, April 18, 2018 - In a world where humans are increasingly interacting with AI systems, Dr. Mary Czerwinski, Principal Researcher and Research Manager at Microsoft Research, believes emotions may be fundamental to our interactions with machines. And through her team\u2019s work in affective&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/479538"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37074"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=479538"}],"version-history":[{"count":17,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/479538\/revisions"}],"predecessor-version":[{"id":485679,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/479538\/revisions\/485679"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/480324"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=479538"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=479538"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=479538"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=479538"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=479538"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=479538"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=479538"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=479538"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=479538"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=479538"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=479538"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}