{"id":1079,"date":"2021-05-20T10:59:14","date_gmt":"2021-05-20T17:59:14","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?post_type=example&p=1079"},"modified":"2023-05-26T09:51:15","modified_gmt":"2023-05-26T16:51:15","slug":"gender-shades-report-system-performance-information","status":"publish","type":"example","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/","title":{"rendered":"Gender Shades | 2C: Report system performance information"},"content":{"rendered":"
\n\t\n\n

Gender Shades | 2C: Report system performance information<\/h2>\n\n\n\n
\"\"<\/figure>\n\n<\/div>\n\n\n\n\n\n
\"Face
This report, based on the Gender Shades research paper<\/a>, sets expectations for how well the system can do what it can do (Guideline 2<\/a>) by showing group-level performance for different gender classifiers (Pattern 2C<\/a>). Note that systems for gender classification are problematic even if they work well. Image captured July 2020.<\/sub><\/sup><\/em><\/figcaption><\/figure>\n","protected":false},"featured_media":1080,"menu_order":0,"template":"","meta":{"toolkit_pattern_number":"2C","ep_exclude_from_search":false,"footnotes":""},"application-type":[60],"goal":[114,126,123],"guideline-term":[4],"product-category":[],"class_list":["post-1079","example","type-example","status-publish","has-post-thumbnail","hentry","application-type-image-recognition","goal-appropriate-reliance","goal-reliability","goal-transparency","guideline-term-make-clear-how-well-the-system-can-do-what-it-can-do"],"yoast_head":"\nGender Shades | 2C: Report system performance information - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Gender Shades | 2C: Report system performance information - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-26T16:51:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/05\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png\" \/>\n\t<meta property=\"og:image:width\" content=\"960\" \/>\n\t<meta property=\"og:image:height\" content=\"770\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/\",\"name\":\"Gender Shades | 2C: Report system performance information - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2021\\\/05\\\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png\",\"datePublished\":\"2021-05-20T17:59:14+00:00\",\"dateModified\":\"2023-05-26T16:51:15+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2021\\\/05\\\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2021\\\/05\\\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png\",\"width\":960,\"height\":770,\"caption\":\"This report, based on the Gender shades research paper, shows group-level performance for different gender classifiers. Note that systems for gender classification are problematic even if they work well.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/example\\\/gender-shades-report-system-performance-information\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G2: Make clear how well the system can do what it can do.\",\"item\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/guideline\\\/make-clear-how-well-the-system-can-do-what-it-can-do\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Gender Shades | 2C: Report system performance information\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#website\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/uploads\\\/2022\\\/07\\\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\\\/\\\/www.microsoft.com\\\/en-us\\\/haxtoolkit\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Gender Shades | 2C: Report system performance information - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/","og_locale":"en_US","og_type":"article","og_title":"Gender Shades | 2C: Report system performance information - Microsoft HAX Toolkit","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2023-05-26T16:51:15+00:00","og_image":[{"width":960,"height":770,"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/05\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/","name":"Gender Shades | 2C: Report system performance information - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2021\/05\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png","datePublished":"2021-05-20T17:59:14+00:00","dateModified":"2023-05-26T16:51:15+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2021\/05\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2021\/05\/50116-G02-C_ReportSystemPerformance_GenderShades-annotated.png","width":960,"height":770,"caption":"This report, based on the Gender shades research paper, shows group-level performance for different gender classifiers. Note that systems for gender classification are problematic even if they work well."},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/example\/gender-shades-report-system-performance-information\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G2: Make clear how well the system can do what it can do.","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/"},{"@type":"ListItem","position":3,"name":"Gender Shades | 2C: Report system performance information"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/1079","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/example"}],"version-history":[{"count":10,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/1079\/revisions"}],"predecessor-version":[{"id":10002,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/example\/1079\/revisions\/10002"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media\/1080"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=1079"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=1079"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=1079"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=1079"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=1079"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}