We develop a framework for zero-shot learning (ZSL) with a goal towards understanding recognition for scenarios where certain class-specific training data could be limited or unavailable. We explore ZSL as a prototypical instance of multimedia recognition to understand how multi-domain data (e.g. words, phrases, attributes) can help overcome lack of training data in the target domain (e.g. videos, images). We develop ZSL and its variations to investigate the value of having different degrees of information about test data. We pose ZSL as a class-independent binary hypothesis testing problem and develop shared latent representations for fusing multimedia data. We develop a joint discriminative learning framework to train class-independent latent representations and show that our resulting decision function learns to recognize similarity between source-target domain data pairs. We develop a modular optimization approach to account for various types of partial information that may become available during test time based on fusing predictions from learned similarity functions with any available test-time information. We test our method on several benchmark datasets, achieving state-of-the-art results.<\/p>\n","protected":false},"excerpt":{"rendered":"
We develop a framework for zero-shot learning (ZSL) with a goal towards understanding recognition for scenarios where certain class-specific training data could be limited or unavailable. We explore ZSL as a prototypical instance of multimedia recognition to understand how multi-domain data (e.g. words, phrases, attributes) can help overcome lack of training data in the target […]<\/p>\n","protected":false},"featured_media":275625,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-video-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-284138","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/5W7eYrA9Zb8","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/284138"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":0,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/284138\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/275625"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=284138"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=284138"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=284138"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=284138"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=284138"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=284138"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=284138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}