{"id":1065405,"date":"2024-08-14T09:00:00","date_gmt":"2024-08-14T16:00:00","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=1065405"},"modified":"2024-08-14T11:25:18","modified_gmt":"2024-08-14T18:25:18","slug":"research-focus-week-of-august-12-2024","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/research-focus-week-of-august-12-2024\/","title":{"rendered":"Research Focus: Week of August 12, 2024"},"content":{"rendered":"\n

Welcome to Research Focus, a series of blog posts that highlights notable publications, events, code\/datasets, new hires and other milestones from across the research community at Microsoft.<\/p><\/blockquote><\/figure>\n\n\n\n

\"Research<\/figure>\n\n\n\n
\n

EVENT<\/h2>\n\n\n\n

Register now for Research Forum on September 3<\/h2>\n\n\n\n

Discover what\u2019s next in the world of AI at Microsoft Research Forum (opens in new tab)<\/span><\/a>, an event series that explores recent research advances, bold new ideas, and important discussions with the global research community. <\/p>\n\n\n\n

In Episode 4, you\u2019ll learn about the latest multimodal AI models, advanced benchmarks for AI evaluation and model self-improvement, and an entirely new kind of computer for AI inference and hard optimization. Discover how these research breakthroughs and more can help advance everything from weather prediction to materials design.<\/p>\n\n\n\n

Your one-time registration includes access to our live chat with researchers on the event day and additional resources to dive into the research.<\/p>\n\n\n\n

Episode 4 will air Tuesday, September 3 at 9:00 AM Pacific Time.<\/p>\n\n\n\n

\n
Register now<\/a><\/div>\n<\/div>\n<\/div>\n\n\n\n\t
\n\t\t\n\n\t\t

\n\t\tSpotlight: Blog post<\/span>\n\t<\/p>\n\t\n\t

\n\t\t\t\t\t\t
\n\t\t\t\t\n\t\t\t\t\t\"White\n\t\t\t\t<\/a>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t
\n\n\t\t\t\t\t\t\t\t\t

Eureka: Evaluating and understanding progress in AI<\/h2>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

How can we rigorously evaluate and understand state-of-the-art progress in AI? Eureka is an open-source framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings. Learn more about the extended findings.\u00a0<\/p>\n\t\t\t\t\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t
\n\t\t\t\t\t\t\n\t\t\t\t\t\t\tRead more\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t<\/div>\n\t<\/div>\n\t\n\n\n
\n

NEW RESEARCH<\/h2>\n\n\n\n

Towards Effective AI Support for Developers: A Survey of Desires and Concerns<\/h2>\n\n\n\n

Talking to customers provides important insights into their challenges as well as what they love. This helps identify innovative and creative ways of solving problems (without creating new ones) and guards against ruining workflows that customers actually like. However, many AI-related development tools are currently being built without consulting developers. <\/p>\n\n\n\n

In a recent paper: Towards Effective AI Support for Developers: A Survey of Desires and Concerns<\/a>, researchers from Microsoft explore developers\u2019 perspectives on AI integration in their workflows. This study reveals developers\u2019 top desires for AI assistance along with their major concerns. The findings of this comprehensive survey among 791 Microsoft developers help the researchers identify key areas where AI can enhance productivity and how to address developers’ concerns. The findings provide actionable insights for product teams and leaders to create AI tools that truly support developers\u2019 needs.<\/p>\n\n\n\n

\n
Read the paper<\/a><\/div>\n<\/div>\n\n\n\n
\n<\/div>\n\n\n\n
\n

NEW RESEARCH<\/h2>\n\n\n\n

SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation<\/h2>\n\n\n\n

Cloud service providers have used geographical redundancies in hardware to ensure availability of their cloud infrastructure for years. However, for AI workloads, these redundancies can inadvertently lead to hidden degradation, also known as \u201cgray failure.\u201d This can reduce end-to-end performance and conceal performance issues, which complicates root cause analysis for failures and regressions.<\/p>\n\n\n\n

In a recent paper: SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation (opens in new tab)<\/span><\/a>, Microsoft researchers and Azure cloud engineers introduce a proactive validation system specifically for AI infrastructure that mitigates hidden degradation caused by hardware redundancies <\/s>. The paper, which won a \u201cbest paper\u201d award at USENIX ATC<\/em><\/strong> (opens in new tab)<\/span><\/a>, outlines SuperBench\u2019s comprehensive benchmark suite, capable of evaluating individual hardware components and representing most real AI workloads. It includes a validator, which learns benchmark criteria to clearly pinpoint defective components, and a selector, which balances validation time and issue-related penalties, enabling optimal timing for validation execution with a tailored subset of benchmarks. Testbed evaluation and simulation show SuperBench can increase the mean time between incidents by up to 22.61x. SuperBench has been successfully deployed in Azure production, validating hundreds of thousands of GPUs over the last two years.<\/p>\n\n\n\n

\n
Read the paper<\/a><\/div>\n\n\n\n
View GitHub<\/a><\/div>\n<\/div>\n\n\n\n
\n<\/div>\n\n\n\n
\n

NEW RESEARCH<\/h2>\n\n\n\n

Virtual Voices: Exploring Individual Differences in Written and Verbal Participation in Meetings<\/h2>\n\n\n\n

A key component of team performance is participation among group members. Workplace meetings provide a common stage for such participation. But with the shift to remote work, many meetings are conducted virtually. In such meetings, chat offers an alternate avenue of participation, in which attendees can synchronously contribute to the conversation through writing.<\/p>\n\n\n\n

In a recent paper: Virtual Voices: Exploring Individual Differences in Written and Verbal Participation in Meetings (opens in new tab)<\/span><\/a>, researchers from Microsoft and external colleagues explore factors influencing participation in virtual meetings, drawing on individual differences (status characteristics theory), psychological safety perceptions, and group communication. Results of the paper, published in the Journal of Vocational Behavior (opens in new tab)<\/span><\/a>, reveal gender (self-identified) and job level nuances. Women engaged more in chat, while men verbally participated more frequently, as measured using meeting telemetry. Further, men highest in job level verbally contributed the most in virtual meetings, whereas women highest in job level use the chat the most frequently. Regarding type of chats sent, women use emoji reactions more often than men, and men send more attachments than women. Additionally, results revealed psychological safety moderated the relationship between job level and overall chat participation, such that employees low in job level with high perceptions of psychological safety sent more chats than their counterparts. This study provides insights into communication patterns and the impact of psychological safety on participation in technology-mediated spaces. <\/p>\n\n\n\n

\n
Read the paper<\/a><\/div>\n<\/div>\n\n\n\n
\n<\/div>\n","protected":false},"excerpt":{"rendered":"

In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers\u2019 AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.<\/p>\n","protected":false},"author":42735,"featured_media":1065426,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"categories":[1],"tags":[],"research-area":[13556,13554,13559,13547],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[243984],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-1065405","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research-blog","msr-research-area-artificial-intelligence","msr-research-area-human-computer-interaction","msr-research-area-social-sciences","msr-research-area-systems-and-networking","msr-locale-en_us","msr-post-option-blog-homepage-featured"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199561,199560],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[733597,913161,1021704,442950],"related-projects":[483294],"related-events":[999423],"related-researchers":[{"type":"user_nicename","value":"Mansi Khemka","user_id":43152,"display_name":"Mansi Khemka","author_link":"Mansi Khemka<\/a>","is_active":false,"last_first":"Khemka, Mansi","people_section":0,"alias":"mansikhemka"},{"type":"user_nicename","value":"Brian Houck","user_id":43092,"display_name":"Brian Houck","author_link":"Brian Houck<\/a>","is_active":false,"last_first":"Houck, Brian","people_section":0,"alias":"bhouck"},{"type":"user_nicename","value":"Yifan Xiong","user_id":40702,"display_name":"Yifan Xiong","author_link":"Yifan Xiong<\/a>","is_active":false,"last_first":"Xiong, Yifan","people_section":0,"alias":"yixio"},{"type":"user_nicename","value":"Yuting Jiang","user_id":41868,"display_name":"Yuting Jiang","author_link":"Yuting Jiang<\/a>","is_active":false,"last_first":"Jiang, Yuting","people_section":0,"alias":"yutingjiang"},{"type":"user_nicename","value":"Ziyue Yang","user_id":41653,"display_name":"Ziyue Yang","author_link":"Ziyue Yang<\/a>","is_active":false,"last_first":"Yang, Ziyue","people_section":0,"alias":"ziyyang"},{"type":"user_nicename","value":"Lei Qu","user_id":32650,"display_name":"Lei Qu","author_link":"Lei Qu<\/a>","is_active":false,"last_first":"Qu, Lei","people_section":0,"alias":"lequ"},{"type":"user_nicename","value":"Peng Cheng","user_id":33225,"display_name":"Peng Cheng","author_link":"Peng Cheng<\/a>","is_active":false,"last_first":"Cheng, Peng","people_section":0,"alias":"pengc"},{"type":"user_nicename","value":"Yongqiang Xiong","user_id":35049,"display_name":"Yongqiang Xiong","author_link":"Yongqiang Xiong<\/a>","is_active":false,"last_first":"Xiong, Yongqiang","people_section":0,"alias":"yqx"},{"type":"user_nicename","value":"Lidong Zhou","user_id":32673,"display_name":"Lidong Zhou","author_link":"Lidong Zhou<\/a>","is_active":false,"last_first":"Zhou, Lidong","people_section":0,"alias":"lidongz"},{"type":"user_nicename","value":"Lev Tankelevitch","user_id":43209,"display_name":"Lev Tankelevitch","author_link":"Lev Tankelevitch<\/a>","is_active":false,"last_first":"Tankelevitch, Lev","people_section":0,"alias":"levt"},{"type":"user_nicename","value":"Sean Rintel","user_id":33579,"display_name":"Sean Rintel","author_link":"Sean Rintel<\/a>","is_active":false,"last_first":"Rintel, Sean","people_section":0,"alias":"serintel"}],"msr_type":"Post","featured_image_thumbnail":"\"Research","byline":"","formattedDate":"August 14, 2024","formattedExcerpt":"In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers\u2019 AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/1065405"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/42735"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=1065405"}],"version-history":[{"count":15,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/1065405\/revisions"}],"predecessor-version":[{"id":1073619,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/1065405\/revisions\/1073619"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1065426"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1065405"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=1065405"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=1065405"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1065405"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=1065405"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=1065405"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1065405"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1065405"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=1065405"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=1065405"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=1065405"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}