{"id":35,"date":"2021-04-03T16:24:33","date_gmt":"2021-04-03T16:24:33","guid":{"rendered":"https:\/\/aitoolkit.test\/guideline\/make-clear-why-the-system-did-what-it-did\/"},"modified":"2023-05-24T19:29:41","modified_gmt":"2023-05-25T02:29:41","slug":"make-clear-why-the-system-did-what-it-did","status":"publish","type":"guideline","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/","title":{"rendered":"Make clear why the system did what it&nbsp;did"},"content":{"rendered":"<div class=\"toolkit-heading-with-image-block\">\n\t\n\n<h2 class=\"wp-block-heading\">Guideline 11: Make clear why the system did what it did<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"10\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png\" alt=\"yellow header bar\" class=\"wp-image-8817\" srcset=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png 1024w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-300x3.png 300w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-768x8.png 768w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1536x16.png 1536w, https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-2048x21.png 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading h4\" id=\"do\">Enable the user to access an explanation of why the AI system behaved as it did.<\/h2>\n\n\n\n<p>Make available an explanation for the AI system\u2019s actions\/outputs&nbsp;as&nbsp;appropriate.&nbsp;&nbsp;<\/p>\n\n\n\n<p>Apply this guideline judiciously,&nbsp;keeping&nbsp;in mind that the mere presence of an explanation has been shown to increase user trust. This may cause over-reliance on the system and over-inflated expectations. Over-inflated expectations can lead to trusting an AI even when it could be wrong (automation bias) For setting expectations, see also <a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-what-the-system-can-do\/\">Guideline 1 <\/a>and <a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-how-well-the-system-can-do-what-it-can-do\/\">Guideline 2<\/a>.&nbsp;<\/p>\n\n\n\n<p>The explanation can be global, explaining the entire system, or local, explaining each output. Mix and match&nbsp;explanation patterns&nbsp;as needed, keeping in mind that not all explanations are equal&nbsp;in every scenario.&nbsp;Studies have shown that&nbsp;explanations&#8217; content and design&nbsp;significantly&nbsp;impact&nbsp;whether they help&nbsp;or distract&nbsp;people&nbsp;from achieving their goals.&nbsp;&nbsp;<\/p>\n\n\n\n<p>Use tools such as&nbsp;<a href=\"https:\/\/interpret.ml\/\" target=\"_blank\" rel=\"noreferrer noopener\">InterpretML<\/a>&nbsp;to improve model&nbsp;explainability.&nbsp;<\/p>\n\n\n\n<p>Use&nbsp;Guideline 11 patterns&nbsp;(mix and match as appropriate) to&nbsp;explain the AI system\u2019s behavior:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\">G11-A: Local explanations<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-b-global-explanations\/\">G11-B: Global explanations<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-c-present-properties-of-system-outputs\/\">G11-C: Present properties of system outputs<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-d-map-system-input-attributes-to-system-outputs\/\">G11-D: Map input attributes to system outputs<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-e-map-user-behaviors-to-system-outputs\/\">G11-E: Map user behaviors to system outputs<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-f-example-based-explanations\/\">G11-F: Example-based explanations<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-g-what-if-explanations\/\">G11-G: &#8220;What if?&#8221; explanations<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Enable the user to access an explanation of why the AI system behaved as it did.<\/p>\n","protected":false},"menu_order":11,"template":"","meta":{"toolkit_pattern_number":"","ep_exclude_from_search":false,"footnotes":""},"application-type":[68,61,57,96,60,99,56,55,69,29,58,30,59],"goal":[114,126,123],"guideline-term":[13],"product-category":[71,70,23,64,62,26,66,28,65,31,32,63],"class_list":["post-35","guideline","type-guideline","status-publish","hentry","application-type-classification","application-type-facial-recognition","application-type-filtering-and-ranking","application-type-gen-ai","application-type-image-recognition","application-type-llm","application-type-natural-language-processing-text","application-type-natural-language-processing-voice","application-type-prediction","application-type-recommendation","application-type-route-planning","application-type-search","application-type-text-generation","goal-appropriate-reliance","goal-reliability","goal-transparency","guideline-term-make-clear-why-the-system-did-what-it-did","product-category-advertising","product-category-chatbot","product-category-e-commerce","product-category-email","product-category-health-and-wellness","product-category-navigation","product-category-media-entertainment","product-category-productivity","product-category-search-engine","product-category-social-networks","product-category-voice-assistants","product-category-writing-and-editing"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Make clear why the system did what it did - Microsoft HAX Toolkit<\/title>\n<meta name=\"description\" content=\"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did. Enable the user to access an explanation of why the AI system behaved as it did.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did\" \/>\n<meta property=\"og:description\" content=\"Enable the user to access an explanation of why the AI system behaved as it did.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-25T02:29:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-11.png\" \/>\n\t<meta property=\"og:image:width\" content=\"298\" \/>\n\t<meta property=\"og:image:height\" content=\"442\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did\" \/>\n<meta name=\"twitter:description\" content=\"Enable the user to access an explanation of why the AI system behaved as it did.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-11.png\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\",\"name\":\"Make clear why the system did what it did - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png\",\"datePublished\":\"2021-04-03T16:24:33+00:00\",\"dateModified\":\"2023-05-25T02:29:41+00:00\",\"description\":\"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did. Enable the user to access an explanation of why the AI system behaved as it did.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Make clear why the system did what it&nbsp;did\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Make clear why the system did what it did - Microsoft HAX Toolkit","description":"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did. Enable the user to access an explanation of why the AI system behaved as it did.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/","og_locale":"en_US","og_type":"article","og_title":"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did","og_description":"Enable the user to access an explanation of why the AI system behaved as it did.","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2023-05-25T02:29:41+00:00","og_image":[{"width":298,"height":442,"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-11.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_title":"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did","twitter_description":"Enable the user to access an explanation of why the AI system behaved as it did.","twitter_image":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2021\/10\/G-11.png","twitter_misc":{"Est. reading time":"2 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/","name":"Make clear why the system did what it did - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png","datePublished":"2021-04-03T16:24:33+00:00","dateModified":"2023-05-25T02:29:41+00:00","description":"Human-AI Interaction Guideline No. 11: Make clear why the system did what it did. Enable the user to access an explanation of why the AI system behaved as it did.","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23-1024x10.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"Make clear why the system did what it&nbsp;did"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/35"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/guideline"}],"version-history":[{"count":9,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/35\/revisions"}],"predecessor-version":[{"id":8841,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline\/35\/revisions\/8841"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=35"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=35"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=35"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=35"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=35"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}