Sensing without Sensors
This talk is about tapping the enormous amount of sensor data that we generate about ourselves every day. We’re not talking about traditional sensors, but about mobile devices, mice, keyboards, microphones, cameras etc. that we interact with all the time. Our first explorations of “sensorless” sensing used voice data captured on mobile phones to measure mood and depression. Our most recent work uses ordinary mouse movement to measure stress. From raw mouse movement, we build models of muscle stiffness and find that when people are stressed, they become “tense” in a way that we can reliably measure. We are exploring generalizations of the muscle tension approach to mobile devices.
The second part of the talk will explore the opportunities and risks of rich behavioral data from invisible sensors and social media. These data blur the boundaries between “quantitative” and “qualitative” analysis and suggest the development of new practices that straddle those disciplinary boundaries.
Speaker Details
John Canny is a professor in computer science at UC Berkeley, and holds the Paul and Stacy Jacobs distinguished Professorship in Engineering. His recent work is in health technology, educational technology, and “Designing with data”. His work marries human-computer interaction and social science with signal processing and machine learning. He has designed and deployed production behavioral modeling systems for several Fortune-500 companies, and is a cofounder of Mark Logic Corp.
- Series:
- Microsoft Research Talks
- Date:
- Speakers:
- Jonny Canny
- Affiliation:
- UC Berkeley
-
-
Jeff Running
-
-
Series: Microsoft Research Talks
-
Decoding the Human Brain – A Neurosurgeon’s Experience
Speakers:- Pascal Zinn,
- Ivan Tashev
-
-
-
-
Galea: The Bridge Between Mixed Reality and Neurotechnology
Speakers:- Eva Esteban,
- Conor Russomanno
-
Current and Future Application of BCIs
Speakers:- Christoph Guger
-
Challenges in Evolving a Successful Database Product (SQL Server) to a Cloud Service (SQL Azure)
Speakers:- Hanuma Kodavalla,
- Phil Bernstein
-
Improving text prediction accuracy using neurophysiology
Speakers:- Sophia Mehdizadeh
-
-
DIABLo: a Deep Individual-Agnostic Binaural Localizer
Speakers:- Shoken Kaneko
-
-
Recent Efforts Towards Efficient And Scalable Neural Waveform Coding
Speakers:- Kai Zhen
-
-
Audio-based Toxic Language Detection
Speakers:- Midia Yousefi
-
-
From SqueezeNet to SqueezeBERT: Developing Efficient Deep Neural Networks
Speakers:- Sujeeth Bharadwaj
-
Hope Speech and Help Speech: Surfacing Positivity Amidst Hate
Speakers:- Monojit Choudhury
-
-
-
-
-
'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Project
Speakers:- Peter Clark
-
Checkpointing the Un-checkpointable: the Split-Process Approach for MPI and Formal Verification
Speakers:- Gene Cooperman
-
Learning Structured Models for Safe Robot Control
Speakers:- Ashish Kapoor
-