{"id":978909,"date":"2023-10-24T09:02:02","date_gmt":"2023-10-24T16:02:02","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=978909"},"modified":"2024-06-07T11:56:34","modified_gmt":"2024-06-07T18:56:34","slug":"ai-chat-log-research","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/ai-chat-log-research\/","title":{"rendered":"AI Chat Log Research"},"content":{"rendered":"<section class=\"mb-3 moray-highlight\">\n\t<div class=\"card-img-overlay mx-lg-0\">\n\t\t<div class=\"card-background  has-background- card-background--inset-right\">\n\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"400\" height=\"301\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/10\/b2449f43-0b5b-4514-a04d-156604420b11-6537e7c8b2752.webp\" class=\"attachment-full size-full\" alt=\"Conversations with feedback icon\" style=\"\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/10\/b2449f43-0b5b-4514-a04d-156604420b11-6537e7c8b2752.webp 400w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/10\/b2449f43-0b5b-4514-a04d-156604420b11-6537e7c8b2752-300x226.webp 300w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/10\/b2449f43-0b5b-4514-a04d-156604420b11-6537e7c8b2752-80x60.webp 80w, https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/10\/b2449f43-0b5b-4514-a04d-156604420b11-6537e7c8b2752-240x180.webp 240w\" sizes=\"(max-width: 400px) 100vw, 400px\" \/>\t\t<\/div>\n\t\t<!-- Foreground -->\n\t\t<div class=\"card-foreground d-flex mt-md-n5 my-lg-5 px-g px-lg-0\">\n\t\t\t<!-- Container -->\n\t\t\t<div class=\"container d-flex mt-md-n5 my-lg-5 \">\n\t\t\t\t<!-- Card wrapper -->\n\t\t\t\t<div class=\"w-100 w-lg-col-5\">\n\t\t\t\t\t<!-- Card -->\n\t\t\t\t\t<div class=\"card material-md-card py-5 px-md-5\">\n\t\t\t\t\t\t<div class=\"card-body \">\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n<h1 class=\"wp-block-heading\" id=\"ai-chat-logs-research\">AI Chat Logs Research<\/h1>\n\n\n\n<p>AI Chat Log Research is a v-team collaboration among E+D Office of Applied Research, Microsoft Research, Bing Metrics and Analytics, and Turing to address practical challenges arising from the analysis of AI Chat logs.<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n<p>Large Language Model-based AI is transforming how users interact with assistive systems. Logs of user interactions from new chat and copilot AI systems provide more extensive signals of user satisfaction, success, and enjoyment than conventional search and recommendation logs due to the rich use of natural language in the interactions. Moreover, the LLMs themselves can be leveraged to extract the signals effectively from the natural language in the logs. This combination provides a unique opportunity to utilize the chat logs to quickly understand user intent, assess satisfaction, and characterize usage to drive continuous improvements in the chat and copilot systems over time.<\/p>\n\n\n<span id=\"label-external-link\" class=\"sr-only\" aria-hidden=\"true\">Opens in a new tab<\/span>","protected":false},"excerpt":{"rendered":"<p>AI Chat Log Research is a v-team collaboration among E+D Office of Applied Research, Microsoft Research, Bing Metrics and Analytics, and Turing to address practical challenges arising from the analysis of AI Chat logs. Large Language Model-based AI is transforming how users interact with assistive systems. Logs of user interactions from new chat and copilot [&hellip;]<\/p>\n","protected":false},"featured_media":978924,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"research-area":[13556],"msr-impact-theme":[],"msr-pillar":[],"msr_project_start":"2023-03-15","related-publications":[969405,978903,1042029],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Jennifer Neville","user_id":40946,"people_section":"Related people","alias":"jenneville"},{"type":"user_nicename","display_name":"Tara Safavi","user_id":42021,"people_section":"Related people","alias":"tarasafavi"},{"type":"user_nicename","display_name":"Scott Counts","user_id":31471,"people_section":"Related people","alias":"counts"},{"type":"user_nicename","display_name":"Siddharth Suri","user_id":33766,"people_section":"Related people","alias":"suri"},{"type":"user_nicename","display_name":"Jay Stokes","user_id":32427,"people_section":"Related people","alias":"jstokes"},{"type":"user_nicename","display_name":"Longqi Yang","user_id":38790,"people_section":"Related people","alias":"loy"},{"type":"user_nicename","display_name":"Mengting Wan","user_id":39510,"people_section":"Related people","alias":"mengtwan"},{"type":"user_nicename","display_name":"Sujay Kumar Jauhar","user_id":37071,"people_section":"Related people","alias":"sjauhar"},{"type":"user_nicename","display_name":"Nirupama Chandrasekaran","user_id":33115,"people_section":"Related people","alias":"niruc"}],"msr_research_lab":[199565],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":8,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909\/revisions"}],"predecessor-version":[{"id":1044639,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909\/revisions\/1044639"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/978924"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=978909"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=978909"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=978909"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=978909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}