{"id":695,"date":"2021-05-13T19:53:56","date_gmt":"2021-05-13T19:53:56","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?post_type=pattern&#038;p=695"},"modified":"2023-10-25T07:37:44","modified_gmt":"2023-10-25T14:37:44","slug":"g10-c-fall-back-to-other-strategies","status":"publish","type":"pattern","link":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/","title":{"rendered":"Pattern 10C: Fall back to other&nbsp;strategies"},"content":{"rendered":"\n\n<div class=\"toolkit-heading-with-image-block\">\n\t\n\n<h2 class=\"wp-block-heading\">Pattern 10C: Fall back to other strategies<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\" alt=\"\" \/><\/figure>\n\n<\/div>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"problem\">Problem<\/h4>\n\n\n\n<p>The AI\u2019s uncertainty level is so high that it is unable to take an action.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"solution\">Solution<\/h4>\n\n\n\n<p>Enable the AI system to fall back to other strategies so the interaction with the user can proceed.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"use-when\">Use when<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Other strategies for accomplishing the same user goals are available.<\/li>\n\n\n\n<li>Strategies for fallback are available for situations such as:\n<ul class=\"wp-block-list\">\n<li>Safety-critical applications<\/li>\n\n\n\n<li>Low-latency applications<\/li>\n\n\n\n<li>Legal agreements requirements for system up-time<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"how\">How<\/h4>\n\n\n\n<p>Collaborate with an AI\/ML practitioner to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Get information about the system\u2019s performance and confidence levels.<\/li>\n\n\n\n<li>Get information about the system\u2019s performance or the confidence threshold above which system failure is more likely or more costly for the user.<\/li>\n<\/ul>\n\n\n\n<p>When the system hits the determined threshold, fall back to another automated solutions or to a human (human-in-the-loop).<\/p>\n\n\n\n<p>Automated solutions may include a previous technology,&nbsp;or a model that includes simpler versions of itself.<\/p>\n\n\n\n<p>Fall back to automated solutions may not be noticeable to the user if the difference between the default and the fallback mechanisms is small.<\/p>\n\n\n\n<p>If the fallback is noticeable, consider whether it is appropriate to inform the user about the fallback method or whether to enable the user to make an explicit switch to the fallback method. For example, a user might choose to trade the accuracy of a newer method for the familiarity of a previous one. Informing or providing the optional switch to the user might be particularly appropriate in cases such as:&nbsp;early or Beta versions, high-stakes scenarios, for power users, and so on.<\/p>\n\n\n\n<p>Human-in-the-loop solutions include handing off system control to either the user directly or to user support.<\/p>\n\n\n\n<p>Inform the user of the hand off, giving enough time for consent or reaction.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"user-benefits\">User benefits<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Enables users to continue using the system and accomplish their goals in the case of AI failures.<\/li>\n\n\n\n<li>May make the system usable in a broader range of operating environments (e.g., offline).<\/li>\n\n\n\n<li>May increase safety.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"common-pitfalls\">Common pitfalls<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The fall&nbsp;back does not mitigate the initial issue either because it happens too late or because it is unable to.<\/li>\n\n\n\n<li>Employing fall&nbsp;back strategies frequently disrupts the interaction with the AI system if the fall&nbsp;back is noticeable.<\/li>\n\n\n\n<li>When handing off to a human, hand-off signals are unclear, unnoticeable, or delivered too late.<\/li>\n\n\n\n<li>It is not clear to the user how to take over from the system.<\/li>\n\n\n\n<li>It is not clear to the user what action to take after taking over from the system.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"\u200b\u200b\u200b\u200b\u200b\u200b\u200breferences\">\u200b\u200b\u200b\u200b\u200b\u200b\u200bReferences<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Katz%27s_back-off_model\" target=\"_blank\" rel=\"noreferrer noopener\">Katz&#8217;s back-off model<\/a><\/li>\n\n\n\n<li>Wenchao Li, Dorsa Sadigh, S. Shankar Sastry, and Sanjit A. Seshia. 2014.&nbsp;<a href=\"https:\/\/people.eecs.berkeley.edu\/~sseshia\/pubdir\/huil-tacas14.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Synthesis for human-in-the-loop control systems<\/a>. In&nbsp;<em>Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)<\/em>, Springer Verlag, 470\u2013484. DOI:<a href=\"https:\/\/doi.org\/10.1007\/978-3-642-54862-8_40\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1007\/978-3-642-54862-8_40<\/a><\/li>\n\n\n\n<li>Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andr\u00e9s Monroy-Hern\u00e1ndez. 2017.&nbsp;<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/01\/paper2616.pdf\">Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop.<\/a>&nbsp;In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems&nbsp;(CHI &#8217;17). Association for Computing Machinery, New York, NY, USA, 2382\u20132393. DOI:<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3025453.3025780\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/doi.org\/10.1145\/3025453.3025780<\/a><\/li>\n<\/ul>\n","protected":false},"menu_order":103,"template":"","meta":{"toolkit_pattern_number":"10C","ep_exclude_from_search":false},"application-type":[68,61,57,96,60,99,56,55,69,29,58,30,59],"goal":[126],"guideline-term":[12],"product-category":[71,70,23,64,62,26,66,28,65,31,32,63],"class_list":["post-695","pattern","type-pattern","status-publish","hentry","application-type-classification","application-type-facial-recognition","application-type-filtering-and-ranking","application-type-gen-ai","application-type-image-recognition","application-type-llm","application-type-natural-language-processing-text","application-type-natural-language-processing-voice","application-type-prediction","application-type-recommendation","application-type-route-planning","application-type-search","application-type-text-generation","goal-reliability","guideline-term-scope-services-when-in-doubt","product-category-advertising","product-category-chatbot","product-category-e-commerce","product-category-email","product-category-health-and-wellness","product-category-navigation","product-category-media-entertainment","product-category-productivity","product-category-search-engine","product-category-social-networks","product-category-voice-assistants","product-category-writing-and-editing"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit\" \/>\n<meta property=\"og:description\" content=\"Problem The AI\u2019s uncertainty level is so high that it is unable to take an action. Solution Enable the AI system to fall back to other strategies so the interaction with the user can proceed. Use when How Collaborate with an AI\/ML practitioner to: When the system hits the determined threshold, fall back to another [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft HAX Toolkit\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-25T14:37:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Shipi Dhanorkar\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/\",\"name\":\"Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\",\"datePublished\":\"2021-05-13T19:53:56+00:00\",\"dateModified\":\"2023-10-25T14:37:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"G10: Scope services when in doubt.\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/scope-services-when-in-doubt\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Pattern 10C: Fall back to other&nbsp;strategies\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"name\":\"Microsoft HAX Toolkit\",\"description\":\"Collaborative tools to help you create more effective and responsible human-AI experiences\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization\",\"name\":\"Microsoft Corporation\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png\",\"width\":1536,\"height\":1536,\"caption\":\"Microsoft Corporation\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/","og_locale":"en_US","og_type":"article","og_title":"Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit","og_description":"Problem The AI\u2019s uncertainty level is so high that it is unable to take an action. Solution Enable the AI system to fall back to other strategies so the interaction with the user can proceed. Use when How Collaborate with an AI\/ML practitioner to: When the system hits the determined threshold, fall back to another [&hellip;]","og_url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/","og_site_name":"Microsoft HAX Toolkit","article_modified_time":"2023-10-25T14:37:44+00:00","og_image":[{"url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes","Written by":"Shipi Dhanorkar"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/","name":"Pattern 10C: Fall back to other strategies - Microsoft HAX Toolkit","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage"},"thumbnailUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png","datePublished":"2021-05-13T19:53:56+00:00","dateModified":"2023-10-25T14:37:44+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#primaryimage","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2023\/05\/yellow-header-bar-1536x14-5-23.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/pattern\/g10-c-fall-back-to-other-strategies\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/"},{"@type":"ListItem","position":2,"name":"G10: Scope services when in doubt.","item":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/guideline\/scope-services-when-in-doubt\/"},{"@type":"ListItem","position":3,"name":"Pattern 10C: Fall back to other&nbsp;strategies"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#website","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","name":"Microsoft HAX Toolkit","description":"Collaborative tools to help you create more effective and responsible human-AI experiences","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#organization","name":"Microsoft Corporation","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/uploads\/prod\/2022\/07\/msft-logo.png","width":1536,"height":1536,"caption":"Microsoft Corporation"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/695","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/types\/pattern"}],"version-history":[{"count":9,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/695\/revisions"}],"predecessor-version":[{"id":10983,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/pattern\/695\/revisions\/10983"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/media?parent=695"}],"wp:term":[{"taxonomy":"application-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/application-type?post=695"},{"taxonomy":"goal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/goal?post=695"},{"taxonomy":"guideline-term","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/guideline-term?post=695"},{"taxonomy":"product-category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/haxtoolkit\/wp-json\/wp\/v2\/product-category?post=695"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}