{"id":697,"date":"2021-05-13T19:55:09","date_gmt":"2021-05-13T19:55:09","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?post_type=pattern&#038;p=697"},"modified":"2023-10-25T07:49:18","modified_gmt":"2023-10-25T14:49:18","slug":"g11-a-local-explanations","status":"publish","type":"pattern","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/","title":{"rendered":"Pattern 11A: Local explanations"},"content":{"rendered":"\n\n<div class=\"toolkit-heading-with-image-block\">\n\t\n\n<h2 class=\"wp-block-heading\">Pattern 11A: Local explanations<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\" alt=\"\" \/><\/figure>\n\n<\/div>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"problem\">Problem<\/h4>\n\n\n\n<p>The user needs an explanation for why the system did what it did, and it is important for the user to understand a particular system decision.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"solution\">Solution<\/h4>\n\n\n\n<p>Make an explanation available for one specific action or decision the AI system made.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"use-when\">Use when<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The user wants transparency into the system\u2019s reasoning about a specific action.<\/li>\n\n\n\n<li>Policy or regulations require the system to make available an explanation.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"how\">How<\/h4>\n\n\n\n<p>Get information about how the AI system made the decision. See patterns G11-B-G for different explanation styles.<\/p>\n\n\n\n<p>If a local explanation isn\u2019t possible (e.g., when the AI system doesn\u2019t pass information to the UI that\u2019s useful for a local explanation), consider advocating with your team to pursue known methods for generating such explanations.<\/p>\n\n\n\n<p>Ensure that the representation communicates that the explanation is specific to one system decision. For example, use proximity or other principles of grouping to make that association clear to the user.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"user-benefits\">User benefits<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Enables the user to understand specific AI system decisions.<\/li>\n\n\n\n<li>Enables the user to quickly update their understanding of how the system behaves.<\/li>\n\n\n\n<li>Enables the user to understand the system\u2019s reasoning.<\/li>\n\n\n\n<li>Understanding the system\u2019s reasoning in turn enables the user to predict the system\u2019s behavior and troubleshoot when the system\u2019s behavior is undesirable.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"common-pitfalls\">Common pitfalls<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Alluding or communicating through your design that the same explanation might be true of other decisions. If the explanation does apply to multiple decisions, consider pattern&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-b-global-explanations\/\">G11-B: Global explanations<\/a>.<\/li>\n\n\n\n<li>Giving explanations when the system\u2019s confidence in that decision is low. If confidence is low, consider instead&nbsp;patterns for communicating uncertainty:&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-a-match-the-level-of-precision-in-ui-communication-with-the-system-performance-language\/\">G2-A: Match the level of precision in UI communication with system performance &#8211; Language<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g2-b-match-the-level-of-precision-in-ui-communication-with-the-system-performance-numbers\/\">G2-B:&nbsp;Match the level of precision in UI communication with system performance &#8211; Numbers<\/a>\u200b\u200b\u200b\u200b\u200b\u200b\u200b.&nbsp;See also&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/scope-services-when-in-doubt\/\" target=\"_blank\" rel=\"noreferrer noopener\">Guideline 10,&nbsp;<em>Scope services when in doubt<\/em><\/a>.<\/li>\n\n\n\n<li>Too much information in an explanation can be overwhelming to the user.<\/li>\n\n\n\n<li>The explanation portrays the AI system as more capable than it is or mysterious and impossible to understand (e.g., \u201cmagic\u201d).<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"references\">References<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Aether working group on Transparency (2019).&nbsp;<a href=\"https:\/\/microsoft.sharepoint.com\/teams\/Aether\/SitePages\/Intelligibility-and-Explanation-in-AI.aspx\" target=\"_blank\" rel=\"noreferrer noopener\">What are intelligibility and explanation? Who needs them, and why? How can we achieve them?<\/a><\/li>\n\n\n\n<li>Jennifer Wortman Vaughan, &amp; Hanna Wallach (2020).&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/a-human-centered-agenda-for-intelligible-machine-learning\/\" target=\"_blank\" rel=\"noreferrer noopener\">A Human-Centered Agenda for Intelligible Machine Learning<\/a><\/li>\n\n\n\n<li>Harmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana, Hanna Wallach, and Jennifer Wortman Vaughan. 2020.&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/interpreting-interpretability-understanding-data-scientists-use-of-interpretability-tools-for-machine-learning\/#:~:text=Interpreting%20Interpretability:%20Understanding%20Data%20Scientists%E2%80%99%20Use%20of%20Interpretability%2cbeyond%20academia%20and%20grown%20into%20an%20engineering%20discipline.\" target=\"_blank\" rel=\"noreferrer noopener\">Interpreting Interpretability: Understanding Data Scientists&#8217; Use of Interpretability Tools for Machine Learning<\/a>. In&nbsp;<em>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems<\/em>&nbsp;(<em>CHI &#8217;20<\/em>). Association for Computing Machinery, New York, NY, USA, 1\u201314. DOI:https:\/\/doi.org\/10.1145\/3313831.3376219<\/li>\n<\/ul>\n","protected":false},"menu_order":111,"template":"","meta":{"toolkit_pattern_number":"11A","ep_exclude_from_search":false},"application-type":[68,61,57,96,60,99,56,55,69,29,58,30,59],"goal":[114,126,123],"guideline-term":[13],"product-category":[71,70,23,64,62,26,66,28,65,31,32,63],"class_list":["post-697","pattern","type-pattern","status-publish","hentry","application-type-classification","application-type-facial-recognition","application-type-filtering-and-ranking","application-type-gen-ai","application-type-image-recognition","application-type-llm","application-type-natural-language-processing-text","application-type-natural-language-processing-voice","application-type-prediction","application-type-recommendation","application-type-route-planning","application-type-search","application-type-text-generation","goal-appropriate-reliance","goal-reliability","goal-transparency","guideline-term-make-clear-why-the-system-did-what-it-did","product-category-advertising","product-category-chatbot","product-category-e-commerce","product-category-email","product-category-health-and-wellness","product-category-navigation","product-category-media-entertainment","product-category-productivity","product-category-search-engine","product-category-social-networks","product-category-voice-assistants","product-category-writing-and-editing"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Pattern 11A: Local explanations - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pattern 11A: Local explanations - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:description\" content=\"Problem The user needs an explanation for why the system did what it did, and it is important for the user to understand a particular system decision. Solution Make an explanation available for one specific action or decision the AI system made. Use when How Get information about how the AI system made the decision. [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-25T14:49:18+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\",\"name\":\"Pattern 11A: Local explanations - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\",\"datePublished\":\"2021-05-13T19:55:09+00:00\",\"dateModified\":\"2023-10-25T14:49:18+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G11: Make clear why the system did what it did.\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Pattern 11A: Local explanations\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pattern 11A: Local explanations - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/","og_locale":"en_US","og_type":"article","og_title":"Pattern 11A: Local explanations - Microsoft HAX Toolkit","og_description":"Problem The user needs an explanation for why the system did what it did, and it is important for the user to understand a particular system decision. Solution Make an explanation available for one specific action or decision the AI system made. Use when How Get information about how the AI system made the decision. [&hellip;]","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2023-10-25T14:49:18+00:00","og_image":[{"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/","name":"Pattern 11A: Local explanations - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png","datePublished":"2021-05-13T19:55:09+00:00","dateModified":"2023-10-25T14:49:18+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g11-a-local-explanations\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G11: Make clear why the system did what it did.","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/make-clear-why-the-system-did-what-it-did\/"},{"@type":"ListItem","position":3,"name":"Pattern 11A: Local explanations"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/697"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/pattern"}],"version-history":[{"count":10,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/697\/revisions"}],"predecessor-version":[{"id":11019,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/697\/revisions\/11019"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=697"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=697"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=697"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=697"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}