{"id":185740,"date":"2010-07-14T00:00:00","date_gmt":"2010-12-28T09:39:13","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/msr-research-item\/on-seeing-stuff-the-perception-of-materials-and-surfaces\/"},"modified":"2016-08-22T11:27:32","modified_gmt":"2016-08-22T18:27:32","slug":"on-seeing-stuff-the-perception-of-materials-and-surfaces","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/on-seeing-stuff-the-perception-of-materials-and-surfaces\/","title":{"rendered":"On seeing stuff: the perception of materials and surfaces"},"content":{"rendered":"<div class=\"asset-content\">\n<p>Objects are &#8220;things&#8221; but they are made of &#8220;stuff.&#8221; In both human and machine vision, there has been much research on object recognition, but rather little on material perception. My lab is exploring material perception at various levels. At the low-level, we have identified certain image statistics, such as subband skewness, that are correlated with surface properties such as gloss. We suggest that there are mechanisms in early vision that are sensitive to such statistics, which could be easily computed with neural mechanisms. For our high-level studies, we are evaluating material recognition (categorization): the ability to look at something and decide whether it is, say, leather or plastic or cloth. We have assembled some image databases for use in exploring material recognition. In humans, material recognition can occur at high speed, even when the images are quite diverse. We have used machine vision and machine learning techniques in an attempt to achieve automated categorization of images in our database. While our system outperforms prior systems, it still falls far short of human performance.<\/p>\n<\/div>\n<p><!-- .asset-content --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Objects are &#8220;things&#8221; but they are made of &#8220;stuff.&#8221; In both human and machine vision, there has been much research on object recognition, but rather little on material perception. My lab is exploring material perception at various levels. At the low-level, we have identified certain image statistics, such as subband skewness, that are correlated with [&hellip;]<\/p>\n","protected":false},"featured_media":280694,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-video-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-185740","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/5w98SOqS8zI","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/185740"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":0,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/185740\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/280694"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=185740"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=185740"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=185740"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=185740"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=185740"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=185740"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=185740"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}