We leverage multiple synchronized instances of a data visualization app on Windows 10 devices such as a Surface Hub, HoloLens and Surface Laptop. This allows each device to see and engage in a collaborative experience with views unique to the capabilities of each device. For example, touch-screen displays can do high-percision selection and filtering of 2D charts to highlight insights in a 3D holographic chart, while a HoloLens allows more natural navigation of 3D charts.
By leverating the position and orientation of the HoloLens, a low-latency view of holographic content can be rendered at a much wider field-of-view on a Surface Hub and high frame-rate. Additionaly, it can be composited with the feed from the Hub cameras. This allows a local audience to experience what a HoloLens is seeing from the 3rd-person perspective of the Hub cameras, and for remote participants on a Teams call to see the holographic content in the room as if it was a real hologram.
Any device in the group can be given control to control the experience, enabling rich collaboration.
This project was shown in the Build 2018 Keynote. See Microsoft Build: Modern Meetings Demo (opens in new tab) (from 8:36 to 11:11).
People
Dave Brown
Principal Engineer