Overcoming language barriers using MAUI

The Mobile Assistance Using Infrastructure (MAUI) project enables a new class of CPU- and data-intensive applications that seamlessly augment the cognitive abilities of users by exploiting speech recognition, NLP, vision, machine learning, and augmented reality. it overcomes the energy limitations of handhelds by leveraging nearby computing infrastructure. This demo, recorded in July of 2009, is one of the first, if not the first phone speech-to-speech, language-to-language real-time translator. We used MAUI to perform real-time Spanish to English speech translation using Bing Translator, and Windows Speech Recognition and Speech Synthesis services running on a nearby edge node. This demo was implemented on a Windows Mobile 6.5 HTC AT&T Fuze.

The system was first publicly demonstrated live at the Microsoft Research Faculty Summit 2009 on July 14. (slides)

 

Date:
Speakers:
Eduardo Cuervo, Victor Bahl
Affiliation:
Microsoft Research