Generative AI in Real-World Workplaces

MSR-TR-2024-29 |

Published by Microsoft

PDF

This report presents the most recent findings of Microsoft’s research initiative on AI and Productivity, which seeks to measure and understand the productivity gains associated with LLM-powered productivity tools like Microsoft Copilot. The report synthesizes research results from over a dozen recent studies conducted by researchers at Microsoft, with a focus on studies of generative AI in actual workplace environments. One of these is, to our knowledge, the largest, randomized controlled trial of the introduction of generative AI into organizations. Overall, the research suggests that generative AI is already aiding workers in becoming more productive in their day-to-day jobs in significant ways. However, the influence of generative AI is subject to variation by role, function, and organization and is contingent upon adoption and utilization. The report explores these variations and underscores the potential for AI to have even greater impact as individuals and organizations recalibrate their work practices to harness AI in the places where it provides the most value.

Slides summarizing the main findings of the report are available Generative-AI-in-Real-World-Workplaces-Deck.pdf

This report is a follow up to the first productivity report released in Dec 2023: Early LLM-based Tools for Enterprise Information Workers Likely Provide Meaningful Boosts to Productivity