News & features
SIGMA: An open-source mixed-reality system for research on physical task assistance
| Dan Bohus and Sean Andrist
Microsoft recently developed and released the Situated Interactive Guidance, Monitoring, and Assistance (SIGMA) system, an open-source research platform, to enable research and innovation at the intersection of mixed reality and AI.
Research at Microsoft 2023: A year of groundbreaking AI advances and discoveries
AI saw unparalleled growth in 2023, reaching millions daily. This progress owes much to the extensive work of Microsoft researchers and collaborators. In this review, learn about the advances in 2023, which set the stage for further progress in 2024.
Frontiers of multimodal learning: A responsible AI approach
New evaluation methods and a commitment to continual improvement are musts if we’re to build multimodal AI systems that advance human goals. Learn about cutting-edge research into the responsible development and use of multimodal AI at Microsoft.
Research at Microsoft 2020: Addressing the present while looking to the future
Microsoft researchers pursue the big questions about what the world will be like in the future and the role technology will play. Not only do they take on the responsibility of exploring the long-term vision of their research, but they…
Platform for Situated Intelligence: An open-source framework for multimodal, integrative AI
| Dan Bohus and Sean Andrist
Over the years at Microsoft Research, we’ve studied how to build AI systems that perceive, understand, and act in a human-filled world in real time. Our motivation has been to create computing systems that can support interactive experiences akin to…
Platform for Situated Intelligence: Tools and Framework for Multimodal Interaction Research
| Dan Bohus
Over the last decade, advances in machine learning coupled with the availability of large amounts of data have led to significant progress on long-standing AI challenges. In domains like computer vision, speech recognition, machine translation and image captioning, machines have…