{"id":480351,"date":"2018-04-18T09:09:10","date_gmt":"2018-04-18T16:09:10","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=480351"},"modified":"2018-04-20T18:09:25","modified_gmt":"2018-04-21T01:09:25","slug":"uncanny-valley-sense-touch","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/uncanny-valley-sense-touch\/","title":{"rendered":"Uncanny Valley and the Sense of Touch"},"content":{"rendered":"

\"\"<\/p>\n

The notion of an \u201cuncanny valley\u201d is well known in robotics[1]. This is when increasing the realism of a robot\u2019s human-like appearance can lead to feelings of unease\u2014or even revulsion\u2014as a robot becomes more and more (but never quite fully) human-like[2].<\/p>\n

While this uncanny valley is related to sight, researchers wondered if an uncanny valley experience also exists for the sense of touch\u2014also known as haptics.<\/p>\n

In a paper recently published in Science Robotics (opens in new tab)<\/span><\/a>[3], a group of Microsoft researchers put forward a new theory of haptics interaction that identifies an uncanny valley for the sense of touch. Their research suggests that when the haptics are not aligned with the rest of the sensory stimulation, it can hinder the experience. The researchers believe that this research will create a new school of thought among designers of touch-enabled interactions and devices.<\/p>\n

Researchers Mar Gonzalez Franco (opens in new tab)<\/span><\/a>, Eyal Ofek (opens in new tab)<\/span><\/a>, Ken Hinckley (opens in new tab)<\/span><\/a> and Christopher Berger (opens in new tab)<\/span><\/a>, a visiting researcher from California Institute of Technology, chose the platform of virtual reality (VR) as a testbed. VR is a great tool for revealing the strange and otherworldly foundation of our everyday sensory perceptions. We can use VR to produce a sensation of touch that feels like it originates in the completely empty space between one\u2019s hands, while holding two controllers.<\/p>\n

Each controller provides the user with synchronous vibrotactile stimuli of different amplitudes. In the virtual environment, we show the participant a wooden dowel that they grip with each hand. The dowel is only imaginary, of course; the hands are not physically linked and the dowel does not exist. We then show a small white marble that seems to knock on the dowel at different locations as we vary the vibratory sensations.<\/p>\n

\"Spatialized

Figure 1: Top: A diagram showing the stimulation points for the spatialized touch generation. Middle: The participant holding the controllers. Bottom: First-person perspective view of their virtual hands and the stick. The amorphous cloud shown here reduces the uncanny valley effect.<\/p><\/div>\n

What\u2019s interesting is that not only is the dowel imaginary, but also that the apparent spatial location of the touch sensation of the marble will persist, even if the marble is invisible. This is because the brain follows the unity rule by which two synchronous events that are connected in time should also be connected in space, thus they have the same cause and origin. In this case, the two vibrations felt in the hands are perceived to be the result of a single touch that comes from the same location along the virtual dowel, no matter if the marble is visible or not.<\/p>\n

In virtual environments, producing higher-fidelity haptic sensations of this sort come with the assumption that such improvements will always yield a more realistic and immersive experience. However, this research found that adding the spatialized touch on its own, without the visual counterpart of the marble, can greatly reduce the perceived realism of and immersion into the virtual environment. That is despite the fact that participants were able to locate the touch sensation equally well when the marble was invisible or visible.<\/p>\n

The video shows the newly found uncanny valley, where an increased quality of haptics generates a drop in the subjective experience. However, this uncanny valley can be shifted or eliminated by subtly manipulating the experimental conditions. The researchers found that by rebalancing the ray of the sensorial experience, particularly by increasing the visual quality to provide a plausible source for the haptic experience, a fuller sense of immersion returns and increases the overall subjective experience.<\/p>\n