{"id":978909,"date":"2023-10-24T09:02:02","date_gmt":"2023-10-24T16:02:02","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=978909"},"modified":"2024-06-07T11:56:34","modified_gmt":"2024-06-07T18:56:34","slug":"ai-chat-log-research","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/ai-chat-log-research\/","title":{"rendered":"AI Chat Log Research"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"Conversations\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

AI Chat Logs Research<\/h1>\n\n\n\n

AI Chat Log Research is a v-team collaboration among E+D Office of Applied Research, Microsoft Research, Bing Metrics and Analytics, and Turing to address practical challenges arising from the analysis of AI Chat logs.<\/p>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

Large Language Model-based AI is transforming how users interact with assistive systems. Logs of user interactions from new chat and copilot AI systems provide more extensive signals of user satisfaction, success, and enjoyment than conventional search and recommendation logs due to the rich use of natural language in the interactions. Moreover, the LLMs themselves can be leveraged to extract the signals effectively from the natural language in the logs. This combination provides a unique opportunity to utilize the chat logs to quickly understand user intent, assess satisfaction, and characterize usage to drive continuous improvements in the chat and copilot systems over time.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"

AI Chat Log Research is a v-team collaboration among E+D Office of Applied Research, Microsoft Research, Bing Metrics and Analytics, and Turing to address practical challenges arising from the analysis of AI Chat logs. Large Language Model-based AI is transforming how users interact with assistive systems. Logs of user interactions from new chat and copilot […]<\/p>\n","protected":false},"featured_media":978924,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-978909","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2023-03-15","related-publications":[969405,978903,1042029],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Jennifer Neville","user_id":40946,"people_section":"Related people","alias":"jenneville"},{"type":"user_nicename","display_name":"Tara Safavi","user_id":42021,"people_section":"Related people","alias":"tarasafavi"},{"type":"user_nicename","display_name":"Scott Counts","user_id":31471,"people_section":"Related people","alias":"counts"},{"type":"user_nicename","display_name":"Siddharth Suri","user_id":33766,"people_section":"Related people","alias":"suri"},{"type":"user_nicename","display_name":"Jay Stokes","user_id":32427,"people_section":"Related people","alias":"jstokes"},{"type":"user_nicename","display_name":"Longqi Yang","user_id":38790,"people_section":"Related people","alias":"loy"},{"type":"user_nicename","display_name":"Mengting Wan","user_id":39510,"people_section":"Related people","alias":"mengtwan"},{"type":"user_nicename","display_name":"Sujay Kumar Jauhar","user_id":37071,"people_section":"Related people","alias":"sjauhar"},{"type":"user_nicename","display_name":"Nirupama Chandrasekaran","user_id":33115,"people_section":"Related people","alias":"niruc"}],"msr_research_lab":[199565],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":8,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909\/revisions"}],"predecessor-version":[{"id":1044639,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/978909\/revisions\/1044639"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/978924"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=978909"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=978909"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=978909"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=978909"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=978909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}