Microsoft SQL Server<\/a> for full text indexing. This enables audio or video content to be searched just as any other textual content can be searched.<\/p>\n\u201cCompatibility with SQL Server is very important,\u201d Chitsaz comments, \u201cbecause it means that searching for spoken words inside audio or video files becomes just like searching for text in an SQL Server database, a process familiar to IT organizations. We are not introducing a new search mechanism. They can maintain the same search infrastructure and processes.\u201d<\/p>\n
A demo of MAVIS at the Microsoft Video Web proves the success of the team\u2019s implementation. The site contains more than 15,000 MSNBC news videos. Searches are fast, and the results enable direct access into a video stream. Users can see textual information, as well as a timeline that shows where a keyword or phrase occurs.<\/p>\n
Unlocking Information in a Disruptive Way<\/h2>\n
Even for Chitsaz, who is intimately familiar with the technology, the information MAVIS delivers still manages to surprise. During Iceland\u2019s volcanic eruptions in April 2010, he used MAVIS to search Microsoft\u2019s video archives to see what was available on the topic of \u201cvolcano.\u201d He found more than he expected: lectures that included imagery, sensors for tracking volcano activity, and interviews with people who had experienced volcano eruptions. When searching through government archives, he has found interesting discussions around topics such as taxes, public safety, and the environment, which still have a bearing on people in a community.<\/p>\n
MAVIS, Chitsaz says, is a disruptive technology that will affect the way we consume speech content, much the same way web searches affected the consumption of text content on the Internet.<\/p>\n
\u201cEach time I experience the value of MAVIS for myself,\u201d he says, \u201cit occurs to me that the textual information originally associated with the files did not include the term I was searching on. Without MAVIS, I would not have known about the information locked in those files.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"
By Janie Chang, Writer, Microsoft Research Not long ago, Internet content was mostly text-based, with search tools supporting the need to index text efficiently and browsers providing the ability to search within a document for every instance of a keyword or phrase. Now, multimedia content has exploded onto the scene, thanks to technology that makes […]<\/p>\n","protected":false},"author":39507,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"categories":[205399,194480,194460],"tags":[186474,214346,186604,214340,214334,214352,202621,193659,214343,196484,196575,186467,187251,214349,214337,197281,186688],"research-area":[13551,13555],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-305861","post","type-post","status-publish","format-standard","hentry","category-azure","category-graphics-and-multimedia","category-search-and-information-retrieval","tag-audio","tag-automated-indexing","tag-bing","tag-indexing","tag-internet-content","tag-manual-transcriptions","tag-mavis","tag-microsoft-azure","tag-microsoft-research-audio-video-indexing-system","tag-microsoft-sql-server","tag-multimedia","tag-multimedia-search","tag-photos","tag-searching-of-digitized-spoken-content","tag-speech-content","tag-speech-recognition","tag-video","msr-research-area-graphics-and-multimedia","msr-research-area-search-information-retrieval","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199560],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"May 26, 2011","formattedExcerpt":"By Janie Chang, Writer, Microsoft Research Not long ago, Internet content was mostly text-based, with search tools supporting the need to index text efficiently and browsers providing the ability to search within a document for every instance of a keyword or phrase. Now, multimedia content…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/305861"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=305861"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/305861\/revisions"}],"predecessor-version":[{"id":305882,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/305861\/revisions\/305882"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=305861"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=305861"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=305861"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=305861"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=305861"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=305861"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=305861"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=305861"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=305861"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=305861"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=305861"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}