As we gather for Microsoft Ignite 2024, we invite you to explore the latest advancements in AI and discover how these innovations can transform your business. With AI-powered agents, organizations can analyze vast amounts of data, adapt to changing environments, and execute complex processes, bringing efficiency and intelligence to your operations. Whether it’s automating customer service interactions, optimizing supply chain logistics, enhancing personalized shopping experiences, or driving sustainability efforts, the potential applications are vast and impactful.

Join us on this journey to unlock the potential of AI and pave the way for a more intelligent, connected, and sustainable world. Together, let’s embrace the future of innovation and drive exceptional value for our customers.

Innovating with new adapted AI models and agents

Adapted AI models are transforming industries by enabling new applications and driving business outcomes such as increased accuracy, enhanced efficiency, better decision-making, and improved customer experiences. These models are designed to meet specific industry needs and tasks, addressing unique challenges more accurately and effectively. By using customized AI for their needs, organizations can enhance their digital presence, improve customer engagement, and streamline operations. With a focus on trustworthy AI, which includes safety, security, and privacy, our AI solutions adhere to high standards of integrity and responsibility, offering a secure approach to advancing industry capabilities. These adapted AI models enable the creation of custom AI solutions within Azure AI Studio and can also be used to configure agents for specific industry scenarios in Microsoft Copilot Studio scenarios. 

We are collaborating with several partners across multiple industries on these adapted and fine-tuned AI models, which are available through the Azure AI model catalog, empowering organizations to build custom AI solutions to address their most pressing needs. Bayer, for instance, offers the E.L.Y. Crop Protection model to enhance sustainable crop protection in the agriculture sector. Cerence provides the CaLLM™ Edge model for in-vehicle digital assistant technology, while Rockwell Automation’s FT Optix Food & Beverage model supports asset troubleshooting in manufacturing. Saifr introduces models for regulatory compliance in financial institutions, and Siemens Digital Industries Software offers a copilot for NX X software leveraging an industry model to optimize the design process. Sight Machine’s Factory Namespace Manager standardizes factory data for AI readiness, and open-source models from Hugging Face are available for summarization and sentiment analysis of financial data. 

Microsoft also provides AI agents designed for various industry scenarios through Copilot Studio. These agents can be customized to meet the specific needs of different organizations. For example, retailers can use the Store Operations Agent to assist store associates, and manufacturers can utilize the Factory Operations Agent to enhance production efficiency. The new release of Agent Builder (preview) in Copilot Studio enables users to create agents directly in Business Chat and SharePoint by defining the agent’s purpose, configuring its knowledge base, and setting up starter prompts. With a user-friendly design requiring only low-code skills, Agent Builder allows integration of diverse data sources to customize agents with industry-specific knowledge and capabilities, improving their effectiveness in addressing key use cases for each industry. 

To learn more about the new adaptive AI models for Industry that are available in Azure AI model catalogue and directly through our partners, visit Azure AI model catalog.

Financial services

Microsoft Copilot and Microsoft Cloud for Financial Services are leading the generative AI revolution in financial services, empowering industry professionals to securely and easily incorporate rich industry data and specialty data sets into their everyday activities while providing enhanced security and compliance at the same time. Microsoft has dedicated itself to generating strong partner momentum across the financial services space, including through creating and offering the tools Microsoft partners need to drive innovation, mutual growth, and success both now and as the capabilities of generative AI continue to evolve. LSEG (London Stock Exchange Group), among others, has already built pioneering new solutions aligned to this initiative.

Built in collaboration with LSEG, Financial Meeting Prep (see the recent announcement using the preview name, Meeting Prep for Financial Services) aims to streamline client meeting preparation for investment banking professionals. Combining LSEG Workspace, Microsoft Teams, and Microsoft 365 Copilot, the solution will consolidate important data, introduce organization-specific insights, easily refresh content as new data becomes available, and enhance relationship manager productivity and decision-making. General availability of Financial Meeting Prep is expected by the end of 2024.

Financial Insights Agent in Copilot Studio

Gathering insights from online sources and proprietary financial documents is crucial for making investment decisions, strategizing, and conducting assessments. However, finding the right data can be time-consuming for financial services professionals, and reviewing the vast amounts of relevant information is nearly impossible.

With the Financial Insights Agent, now available in Copilot Studio, financial services professionals can quickly and easily gather information from financial news and regulatory reporting websites. And because this agent comes ready-made and is easily customized agent, you don’t need advanced development skills to get started.

The Financial Insights Agent gives high-quality results and works best when integrated with the financial document analysis skill for agents (preview), available in Azure Marketplace, which makes it possible for users to gain info and insights from financial documents provided by their organization, such as analyst reports and other complex financial documents that are stored in-house—even when the data is found in complex financial tables, graphs, or charts. This skill not only works with the Financial Insights Agent, but it can also be integrated into custom agents. For example, Reflexivity has been integral in helping Microsoft understand challenges in the industry. Within their own platform, they use this skill for certain document flows, helping financial services professionals derive insights from both structured and unstructured data more efficiently so they can make informed decisions faster.

Financial Services landing zones

Microsoft has recently developed and is now ready to introduce a new Financial Services landing zone. Based on the Azure landing zone—a secure, scalable cloud foundation tailored for compliance needs—the Financial Services landing zone is an infrastructure-as-code solution that provides the baseline governance, resilience, security, automation, and prescriptive guidance that Microsoft industry partners and other financial services organizations need in order to comply with the industry’s strict, mission-critical regulations. As the Financial Services landing zone also provides financial services organizations of all kinds a robust and compliant cloud environment, the solution represents a powerful means to accelerate digital transformation initiatives.

Manufacturing

The manufacturing industry is experiencing a dynamic transformation, with opportunities for growth and innovation despite challenges like economic uncertainty and supply chain disruptions. Microsoft and its partners are at the forefront of this evolution, empowering manufacturers with cutting-edge solutions that help enable intelligent factories, resilient supply chains, and enhanced customer experiences.

Manufacturing data solutions in Microsoft Fabric

During Hannover Messe 2024, we announced the preview of manufacturing data solutions in Microsoft Fabric. This solution integrates operational technology (OT) data, with information technology (IT) data, creating a comprehensive data foundation structured according to the ISA-95 information model.¹ This standardized approach enables manufacturers to break down data silos, enabling cross-domain insights, streamlined processes, and data-driven decision-making. Partner solutions from Sight Machine, Litmus, and Avanade further enhance these capabilities.

Sight Machine Factory Copilot on Microsoft Cloud for Manufacturing transforms your manufacturing execution systems (MES) data into the ISA-95 standard for consumption in manufacturing data solutions in Fabric, which can be surfaced through factory agent experiences to help address operational issues on the factory floor.

Litmus Edge Manager enables a robust hybrid edge-to-cloud infrastructure, streamlining real-time machine dashboards and facilitating advanced machine learning. Litmus and the manufacturing data solutions in Fabric unlocks unprecedented efficiency and innovation, seamlessly bridging the gap between edge and cloud.

Learn how to get started with manufacturing data solutions in Microsoft Fabric and Factory Operations Agent.

Factory Operations Agent in Microsoft Azure AI

We’re excited to announce the public preview of the Factory Operations Agent in Azure AI, which empowers manufacturers to develop customized, AI-powered agents for frontline workers. These intelligent assistants leverage natural language processing and retrieval-augmented generation, making complex data analytics accessible for scenarios like root cause analysis, production loss reduction, continuous improvement, and asset maintenance. With the Factory Operations Agent, factory teams can intuitively interact with data, receive timely insights, and resolve issues more efficiently—ultimately enhancing productivity and empowering the workforce to drive operational excellence.

Avanade Manufacturing Copilot, powered by manufacturing data solutions in Fabric, helps customers to overcome OT-IT data accessibility and utilization challenges and leverage AI at-scale to make higher-quality products faster with less waste.

Learn how to get started with Factory Operations Agent in Azure AI (preview).

Factory Safety Agent in Microsoft Copilot Studio

The new Factory Safety Agent in Copilot Studio (preview) is focused on workplace safety. Factory Safety Agent provides organizations with a low code option to quickly develop a customized agent, grounded in occupational health and safety data. Whether using publicly available standards like Occupational Safety and Health Administration (OSHA) or specific protocols of the organization, this agent can provide critical safety information, insights to factory workers, and streamline critical activities such as safety inspections or incident reporting to reduce risks and ultimately accidents.

Retail

As the retail industry adapts to new customer expectations and competitive pressures, Microsoft and its partners are providing tools for retailers that offer real-time insights, enhance customer engagement, and drive digital innovation.

Retail Data Solutions in Microsoft Fabric

Retail Data Solutions in Microsoft Fabric help retailers unify and standardize their data. This platform enables customers to integrate data from different systems and offers ready-to-use agents to speed up AI transformations. Currently in public preview, it includes four customizable features for retail:

• Retail Industry Data Model: Plan and design data solutions for governance, reporting, business intelligence, and analytics.
• Frequently Bought Together: Use insights to enhance upselling, shelf optimization, and store efficiency.
• Sitecore OrderCloud Connector: Standardize commerce data from Sitecore OrderCloud to gain actionable insights.
• Personalized Shopping Agent: Improve shopping experiences with tailored customer conversations.

Personalized Shopping Agent

The Personalized Shopping Agent can engage in natural language conversations to understand and respond to shoppers’ needs. It provides tailored recommendations based on the shopper’s specific requirements and preferences. Additionally, it can handle specific requests, such as finding matching items or suggesting outfits for specific occasions. The agent leverages Retail Data Solutions, using aggregated product catalogs, and AI orchestration tools to provide accurate and contextually relevant answers.   

Store Operations Agent

The Store Operations Agent revolutionizes how store associates handle daily tasks with its headless architecture that integrates into applications or websites. It offers ready-to-deploy plugins for:

• Product search or inventory search: Real-time access to product details and stock.
• Order details: Tracks order information down to the line level.
• Incident management: Resolves incidents using Copilot and ServiceNow.
• Task management: Integrates directly with tasking apps.
• Omni channel access: Provides natural language access to current prices, promotions, and information.

The agent integrates seamlessly with Dynamics 365 Finance, Dynamics 365 Commerce, and ServiceNow. These integrations can extend to other enterprise resource planning (ERP) software and applications with pre-built connectors and APIs. These features are continually updated, adding more plugins to help partners scale operations.

Partners can also utilize the Store Operations Agent alongside their own solutions to accelerate customer adoption. Accenture Avanade has launched a Clienteling copilot, which has Store Operations Agent embedded and assists store associates in managing daily tasks efficiently. It also offers a natural language query interface for store policies and procedures, enabling informed decision-making for store associates and managers.

Public sector

Microsoft is leading the way in helping government and regulated organizations address their compliance, security, and data sovereignty requirements while adopting modern digital technologies. With initiatives like Microsoft Cloud for Sovereignty and generative AI, Microsoft offers comprehensive solutions tailored to diverse regulatory landscapes, enabling organizations to streamline their compliance processes and enhance their digital capabilities.

Citizen Services agent

Available in Copilot Studio, Citizen Services agent allows public sector organizations to create AI-powered agents using their public websites and information. The agent helps citizens navigate government services and information through a Q&A experience, providing answers from configured knowledge bases, such as responses about city plans, road closures, or service applications, offering citizens access to up-to-date information.

Get started with the Citizen Services agent in Copilot Studio.

Regulated Environment Management

Regulated Environment Management (REM) in Azure, currently in private preview, supports cloud adoption as part of Microsoft Cloud for Sovereignty. REM simplifies the configuration, deployment and management of regulated environments through landing zones, policy and drift analysis. Starting November 2024, REM will shift to a subscription-level service, offering benefits like data isolation, regional boundaries, and group management of landing zone configurations. Transparency logs and the Landing Zone Account (LZA) simplify managing configurations and provide data residency. REM also includes a REST API for easier integration.

Request access in the REM private preview.  

Sustainability

With growing demands for disclosure requirements under regulatory directives like the European Union Corporate Sustainability Reporting Directive (CSRD), the pursuit of impactful initiatives such as decarbonization, and the increasing need for transparency in corporate sustainability claims, businesses are under pressure to demonstrate genuine commitment to sustainability. To address these challenges, Microsoft Cloud for Sustainability is introducing Sustainability data solutions in Microsoft Fabric and enhanced reporting in Microsoft Sustainability Manager.

Sustainability data solutions in Microsoft Fabric

Now generally available, Sustainability data solutions in Microsoft Fabric enables customers to unify environmental, social, and governance (ESG) data with organizational data, fostering innovation, process changes, and simplified reporting. With Microsoft Fabric, businesses can create a standardized sustainability data lake for their ESG needs. Features include an extensible ESG data schema, pre-built notebooks for data transformations, data pipelines for various business systems (including Microsoft Sustainability Manager), and built-in dashboards for analyzing ESG topics.

OneLake in Fabric allows businesses to enhance sustainability by building analytical insights with AI and machine learning models and using Copilot agents for autonomous workflows. Learn more about Sustainability data solutions in Microsoft Fabric.

Partners like UST Global use Sustainability data solutions in Fabric to develop flexible ESG systems of record that align with sustainability goals. Leveraging Microsoft Fabric, they craft customizable solutions for unique ESG challenges and adapt as requirements evolve.

Sustainability data solutions in Fabric offers tools to manage ESG data complexities, improve data integration and accuracy, provide real-time insights, and support compliance. This platform helps meet regulatory and stakeholder expectations and drives effective sustainability efforts across organizations.

External reporting in Microsoft Sustainability Manager

Also in general availability, the new external reporting capabilities in Microsoft Sustainability Manager (formerly Project ESG Reporting) simplifies external reporting across various standards with AI-powered insights and recommendations, making it easier for organizations to prepare and manage disclosure reports. Users can seamlessly connect, organize, review, and report data according to global standards.

Whether used as a standalone solution through the Power Platform gallery or integrated within Microsoft Sustainability Manager, it supports custom frameworks, iXBRL compatibility through partners, and offers a workflow user interface (UI) for editing and approvals. These new capabilities reduce the complexities of compliance, helping businesses stay on top of their sustainability reporting.

Using Copilot Studio with Microsoft Cloud for Sustainability

Copilot Studio is a key part of the Microsoft Cloud for Sustainability toolkit, helping users create customized agents to meet sustainability and compliance goals. As compliance standards change, Copilot Studio uses large language models (LLM) to help organizations adapt quickly. It offers pre-built connectors for easy data integration, reducing the time and effort needed to manage diverse data sources and focus on actionable insights. Current features include the Sustainability Insights Agent for interacting with sustainability reports, with upcoming agents for estimating European Union Carbon Border Adjustment Mechanism (CBAM) costs and setting goals. This tool, combined with our network of partners, helps organizations achieve their ESG goals by unifying data intelligence and streamlining sustainability management.

Shaping the future with AI

Join us on this journey to unlock the potential of AI and pave the way for a more intelligent, connected, and sustainable world. Together, let’s embrace the future of innovation and drive exceptional value for our customers. By leveraging the latest advancements in AI, we can transform industries, enhance productivity, and create meaningful experiences for everyone. Whether it’s through automating routine tasks, optimizing operations, or providing personalized services, the possibilities are endless. Let’s work together to harness the power of AI and make a lasting impact on our businesses and communities. 

Watch the Ignite 2024 sessions

Watch Accelerating industry partner growth in the age of AI with Kathleen Mitford and Satish Thomas and Delivering adapted AI models for industries with partners.

Financial Services

• Accelerate AI Innovation with Microsoft Cloud for Financial Services 
• Empowering the financial services partner ecosystem with Generative AI

Manufacturing

• Democratize data-driven decision making across factory operations with AI

Retail

• Elevate the retail experience with the Personalized Shopping Agent 
• Empower the retail workforce with the Store Operations Agent 

Public Sector

• Accelerate Cloud Adoption with Software-Defined Sovereignty 
• Collaborating with partners for digital sovereignty in the cloud 
• Deploying AI with Sovereign controls

Sustainability

• Accelerating ESG progress with sustainability data solutions in Fabric 
• Sustainability reduction and calculation compliance simplified with Copilot Studio and Microsoft Sustainability Manager 
• Building solution practices for Microsoft Cloud for Sustainability 
• Implementation best practices for Microsoft Cloud for Sustainability 

Microsoft Ignite 2024

Experience the latest innovations for AI transformation

Discover more

¹ https://www.isa.org/standards-and-publications/isa-standards/isa-95-standard

The post Unlocking the future: AI and data revolutionize industries at Microsoft Ignite 2024 appeared first on Microsoft AI Blogs.

The post Toyota is deploying AI agents to harness the collective wisdom of engineers and innovate faster appeared first on Microsoft AI Blogs.

• Category: AI

November 19, 2024

AI agents — what they are, and how they’ll change the way we work

By

• Susanna Ray

It’s Monday morning, the caffeine hasn’t kicked in yet, and you have a busy day ahead: Maybe you have piles of returns or new shipping invoices to review, or you need to get the latest updates out to your field technicians or help employees get more efficient IT support.

Now you can get help with all of this and more by simply asking an AI agent to take care of it — while you drink a second cup of coffee and focus on your team’s long-term strategy.

An agent can tackle certain tasks with you or for you, from acting as a virtual project manager to handling more complex assignments like reconciling financial statements to close the books. Microsoft 365 Copilot is already a personal assistant that helps with everything from tedious daily duties to jumpstarting creative projects. Using it to interact with various agents brings a new world of possibilities for organizations to empower their employees, drive business and accomplish even more.

Agents can operate around the clock to review and approve customer returns or go over shipping invoices to help businesses avoid costly supply-chain errors. They can reason over reams of product information to give field technicians step-by-step instructions or use context and memory to open and close tickets for an IT help desk.

“Think of agents as the new apps for an AI-powered world,” says Jared Spataro, Microsoft’s chief marketing officer for AI at Work. “We’re rapidly adding new capabilities to tackle individuals’ biggest pain points at work and drive real business results.”

What are agents, anyway?

An agent takes the power of generative AI a step further, because instead of just assisting you, agents can work alongside you or even on your behalf. Agents can do a range of things, from responding to questions to more complicated or multistep assignments. What sets them apart from a personal assistant is that they can be tailored to have a particular expertise.

For example, you could create an agent to know everything about your company’s product catalog so it can draft detailed responses to customer questions or automatically compile product details for an upcoming presentation.

Other agents can do even more, acting on your behalf, like one that helps fulfill sales orders — freeing you up to focus on building new customer relationships. Having agents handle some of these routine needs can boost productivity across industries, from manufacturing and research to finance and retail, helping businesses save time and money.

You can use ready-made agents in Microsoft 365 and Dynamics 365, or build custom agents to help with more specific needs in Copilot Studio.

Imagine you’re a salesperson with big quarterly goals to meet. Copilot acts as your personal assistant, drafting emails, recapping a meeting you missed and helping you design a polished sales presentation. Meanwhile, an agent specialized in sales lead generation works autonomously in the background to find new prospects you can follow up with later in the week. Copilot partners on daily tasks, and your purpose-built agent uses its customized skills to help you meet your end-of-quarter goals.

Agents are not new. Microsoft has done extensive research in the area and even created a multi-agent library last year for developers around the world, work that helped shape what agents can do today.  They’re getting more attention now because recent advances in large language models (LLMs) help anyone — even outside the developer community — communicate with AI. That agent-LLM duo makes AI tools more tangibly useful.

“People expect AI to do things for them,” not to just generate language, says Ece Kamar, the managing director of Microsoft’s AI Frontiers Lab. “If you want to have a system that can really solve real world problems and help people, that system has to have a good understanding of the world we live in, and when something happens, that system has to perceive that change and take action accordingly.”

Agents are like layers on top of the language models that observe and collect information, provide input to the model and together generate an action plan and communicate that to the user — or even act on their own, if permitted. So both agents and models are equally important pieces of the puzzle, as far as generative AI tools go.

Agents will become more useful and able to have more autonomy with innovations in their three necessary elements: memory, entitlements and tools.

Memory helps provide continuity so that each time you ask for something, it isn’t like starting from scratch.

“To be autonomous you have to carry context through a bunch of actions, but the models are very disconnected and don’t have continuity the way we do, so every prompt is in a vacuum and it might pull the wrong memory out,” says Sam Schillace, Microsoft’s deputy chief technology officer. “It’s like you’re watching a stop-motion animation, one isolated frame after another, and your mind puts it into motion. The clay model doesn’t move on its own.”

To build up the memory infrastructure to address this, Schillace and his team are working on a process of chunking and chaining. That’s essentially what it sounds like: They’re experimenting with dividing up interactions in bits that can be stored and linked together by relevance for faster access, akin to a memory — like grouping conversations about a certain project so an agent can recall those details when you ask for a status update and not have to search through its entire database.

The work with entitlements and tools is making sure agents have secure access to, or are entitled to, information they need in order to accomplish things for you, with your permission — like who your boss is, for example — and to the computer programs they need to take action on your behalf, like Teams and PowerPoint.

How to use and build agents for work

You can already create and publish agents in Microsoft 365 Copilot that can help you in your daily work as easily as you’d create a spreadsheet or presentation — no coding skills required.

You don’t need to be a developer to build agents using Copilot Studio, either. Anyone can connect them to relevant business data such as emails, reports and customer management systems so they can perform tasks and provide insights.

And you’ll soon be able to enlist new agents in Microsoft 365 to help with common workflows and tasks. Interpreter in Teams will provide real-time speech-to-speech translation during meetings, for example, and you can opt to have it simulate your voice. The Employee Self-Service Agent will simplify human resource and IT help desk-related tasks like helping workers resolve a laptop issue or find out if they’ve maxed out certain benefits, and it can connect to company systems for further customization in Copilot Studio.

Microsoft Dynamics 365 will have agents as well for a range of common business workflows across sales, supply chain, finance and customer service functions.

And every SharePoint site will soon come equipped with an agent tailored to your organization’s content that allows employees to quickly tap into these vast knowledge bases and find exactly what they need in seconds, whether it’s project details buried in a workback schedule or a summary of a recent product memo.

Developers have even more options. With the new Azure AI Agent Service, you’ll be able to choose from small or large language models to orchestrate, develop and scale agent-powered apps to streamline and automate complex workflows like order processing and customer data synchronization. It provides a software development kit with tools for developing agents, allowing you to efficiently integrate agent capabilities using Visual Studio Code and GitHub.

One type of model, OpenAI’s recently announced o1 series, can bring more advanced reasoning capabilities to agents, allowing them to take on more complicated tasks by breaking them down into steps — like getting the information someone on an IT help desk would need to solve a problem, factoring in solutions they’ve tried and coming up with a plan.

You can also use the power of agents in LinkedIn; the platform’s first agent can help recruiters with hiring.

Assessing risk for autonomous action

There are extra safety considerations with agents that can act autonomously, and Microsoft is focused on making sure agents only access what you want them to, says Sarah Bird, the company’s chief product officer of Responsible AI.

“Agents certainly up the stakes from a responsible AI point of view,” Bird says. “So we have to have much, much lower error rates. And there’s many more nuanced ways in which something could be an error. This is the big challenge with agents.”

But the same responsible AI foundational playbook for other AI applications can be used to assess and mitigate risk with agents, she says.

The new Copilot Control System helps IT departments manage Copilot and agents with data access and governance, management and security controls, as well as measurement reports and tools to track adoption and business value.

Many agents, like those created for Microsoft 365 and Dynamics 365, include “human in the loop” approvals, where people are required to take the final step of reviewing and sending an email the Sales Order Agent wrote, for example. And for agents developed in Copilot Studio, authors can review the records to see which actions the agent took and why.

The key is to focus on testing and moderating to ensure accuracy, Bird says, and for organizations to choose the right starting point for their needs.

“We will of course make progress by building on the foundation we already have, so we’re starting the journey from a strong place,” Bird says.

Looking back — and into the future

Technologists have long been excited by the idea of autonomous systems working side-by-side with people to help them, says Kamar, who has been working on AI agents since 2005 and even wrote her Ph.D. thesis on the topic in 2010. The hurdle was that “we lacked that general problem-solving power” on the back end, she says.

With LLMs, “we finally have this missing component,” she says. “Now we can bring back a lot of the ideas from our decades of research.”

Going forward, Kamar envisions a new ecosystem or marketplace of agents, sort of like how apps empower people to do more with their smartphones.

Agents already have “the basic building blocks of what it takes to complete a task,” she says. “Like observing, ‘I can see your meeting is taking longer; I should delay the next meeting.’”

They’re getting more helpful as they gain autonomy through the innovations in memory and entitlements. They’re relieving pain points for employees by helping with things like expense reporting, project management and meeting facilitation. And they’re driving exponential impact for businesses by taking on duties like alerting supply chain managers to low inventory and then automatically reordering to help drive sales and keep customers satisfied.

Agents matter because they “open up a whole set of opportunities for working with people for getting tasks done, and that’s what we expect from AI systems,” Kamar says. “AI agents are not only a way to get more value for people but are going to be a paradigm shift in terms of how work gets done.”

And this is just the beginning. Copilot is set to evolve with new capabilities like Copilot Actions, designed to handle routine tasks that can bog down employees like summarizing emails missed during time off, compiling agenda items and generating monthly reports. More capabilities like these are coming over the next year to lift the weight of work for employees and teams.

“Copilot will empower every employee to do their best work in less time, and focus on more meaningful tasks,” Spataro says. “And agents created in Copilot Studio will transform every business process, helping companies streamline operations, enhance collaboration and drive innovation at scale.”

Illustrations by Michał Bednarski / Makeshift Studios

The post AI agents — what they are, and how they’ll change the way we work appeared first on Microsoft AI Blogs.

In the case of AI, it is absolutely true that the industry is moving incredibly fast and evolving quickly. It’s also true that hundreds of thousands of customers are using Microsoft AI technology today and, by making early bets on the platform, are seeing big benefits now and future-proofing their ability to benefit from the next big wave of AI improvements.

Microsoft Ignite is our annual event that spotlights the updates and creations that enable customers, partners and developers to unleash the full potential of Microsoft’s technology and change the way we approach work.

This year, we are announcing about 80 new products and features, including new capabilities in Microsoft 365 Copilot, additions to the Copilot + AI stack and new Copilot+ devices offerings. Underpinning each of these innovations is our commitment to security. Since launching our Secure Future Initiative (SFI) one year ago, we have made security the No. 1 job of every employee at Microsoft, dedicated 34,000 engineers to this focus and, at Ignite, we will announce innovations that are rooted in our SFI principles: secure by design, secure by default and secure operations.

More than 200,000 people have registered to join us for this year’s Ignite, with more than 14,000 attendees at our in-person events in Chicago. Attendees can choose from more than 800 sessions, demos and expert-led labs from Microsoft and our partners. Most of the Ignite content will be available on demand for those who can’t attend the live event.

Copilot momentum

Microsoft 365 Copilot is your AI assistant for work, and we have seen the momentum grow as more organizations are moving to Copilot and deploying it to great success. All up, nearly 70% of the Fortune 500 now use Microsoft 365 Copilot.

That echoes an industry trend: A recent IDC study showed that generative AI is on the rise, with 75% adoption among companies surveyed in 2024. In addition, for every $1 invested, companies are realizing a return of $3.70, and leaders are saying they are realizing as much as a $10 return, according to the study.

The investments that Microsoft has made in Copilot are paying dividends for our customers.

We recently highlighted some of the more than 200 customer stories of accelerated AI Transformation, with Copilot helping many of them spark innovation and transform their organization for the better. Several examples include:

• Intelligent power management company Eaton leveraged Microsoft 365 Copilot to help streamline and automate operations, improve data access, centralize knowledge and empower teams to focus on higher-value tasks. One immediate challenge addressed through Copilot focused on the manual, time-consuming documentation process in Eaton’s Finance operations. Copilot helped Eaton document over 9,000 standard operating procedures (SOPs), resulting in an 83% time savings for each SOP.
• Consulting firm McKinsey & Company is creating an agent to speed up the client onboarding process. The pilot showed lead time could be reduced by 90% and administrative work reduced by 30%. The agent automates complex processes, such as identifying the right expert capabilities and staffing teams and acts as a single place where colleagues can ask questions and request follow-ups. By streamlining tasks and reducing manual inputs, this agent could potentially save consultants many hours, allowing them to spend more time with clients.

Boosting productivity with Microsoft 365 Copilot

Microsoft is continuing to supercharge productivity with new capabilities in Microsoft 365 Copilot designed to help simplify the workday.

Copilot Actions, now in private preview, enable anyone to automate everyday tasks with simple, fill-in-the-blank prompts, whether it’s getting a daily summary of meeting actions in Microsoft Teams, compiling weekly reports or getting an email upon return from vacation that summarizes missed meetings, chats and emails.

Anyone can easily set up Actions right in their Microsoft 365 app, allowing users to focus on more impactful work, save time and boost productivity.

New agents in Microsoft 365 are designed to help scale individual impact and transform business process. At Ignite we will introduce:

• Agents in SharePoint: These natural language AI assistants are grounded on relevant SharePoint sites, files and folders to make it easy to find answers from that content, and to make quicker decisions as a result. Now generally available, every SharePoint site will include an agent tailored to its content. Users can also create customized agents scoped to select SharePoint files, folders or sites with as little as one click.
• Interpreter: This agent in Teams helps users overcome language barriers by enabling real-time, speech-to-speech interpretation in meetings. Available in public preview in early 2025, meeting participants will also have the option to have the agent simulate their personal voice.
• The Employee Self-Service Agent: An agent available in private preview in Business Chat expedites answers for the most common policy-related questions and simplifies action-taking on key HR and IT-related tasks — like helping employees understand their benefits or request a new laptop. It can be customized in Copilot Studio to meet an organization’s unique needs.
• Other agents in public preview take real-time meeting notes in Teams and automate project management from start to finish in Planner.

Copilot + AI Stack

The Copilot stack empowers users to build more ambitious products by leveraging advanced technology at each layer of the stack. To create a unified experience where customers can design, customize and manage AI applications and agents, we are introducing Azure AI Foundry, which gives customers access to all existing Azure AI services and tooling, plus new capabilities like:

• Azure AI Foundry SDK, now available in preview, provides a unified toolchain for designing, customizing and managing AI apps and agents with enterprise-grade control and customization. With tools that help organizations responsibly scale their applications, Foundry also provides 25 prebuilt app templates and a simplified coding experience they can access from familiar tools like GitHub, Visual Studio and Copilot Studio.
• Azure AI Foundry portal (formerly Azure AI Studio), now available in preview, is a comprehensive visual user interface to help developers discover AI models, services and tools. With a new management center experience that brings essential subscription information into a single dashboard, the portal also helps IT admins, operations and compliance teams manage AI applications at scale.
• Azure AI Agent Service, coming soon to preview, will enable professional developers to orchestrate, deploy and scale enterprise-ready agents to automate business processes.

We also continue to back up our Trustworthy AI commitments with new tools. Today we’re announcing AI reports and risk and safety evaluations for images to help organizations ensure AI applications are safe and compliant. AI reports will help organizations improve observability, collaboration and governance for AI apps and fine-tuned models, while evaluations for image content will help customers assess the frequency and severity of harmful content in their app’s AI-generated outputs.

Copilot+ devices

As organizations move more workloads to the cloud to enhance security and flexibility, Microsoft is expanding its Cloud PC solution by introducing the first in a new class of devices purpose-built to connect securely to Windows 365 in seconds.

Windows 365 Link is the simple, secure, purpose-built device for Windows 365. It is in preview now and will become generally available for purchase starting in April 2025 in select markets with an MSRP of $349, allowing users to work securely in a familiar Windows desktop in the Microsoft Cloud with responsive, high-fidelity experiences.

Windows 365 Link is secure by design. The device has no local data, no local apps and admin-less users so corporate data stays protected within the Microsoft Cloud.

Other new capabilities for Copilot+ PCs for commercial customers include harnessing the power of inbuilt native processing units (NPUs) to deliver local AI. With improved Windows Search, and the new Recall experience (preview), finding what you need on your PC is easier than ever by just describing what you are looking for. These features are releasing first to our Windows Insider community on Copilot+ PCs before rolling out more broadly to our customers.

BlackRock momentum

Four years ago, BlackRock, one of the world’s pre-eminent asset management firms, formed a strategic alliance with Microsoft to move its Aladdin platform to Microsoft Azure. With this foundation on Azure, BlackRock rolled out generative AI tools for global clients with Aladdin Copilot. Through generative AI, Aladdin Copilot serves to strengthen the connective tissue across the platform, leveraging Microsoft technology to help users receive answers instantly to unlock new efficiencies and discover important business insights even faster. Aladdin Copilot makes BlackRock’s Aladdin platform even more intelligent and responsive. That results in enhanced productivity, enables scale and keeps users more informed.

BlackRock’s move to Azure and launch of Aladdin Copilot are just two of the many ongoing milestones in a long-term partnership that also includes an enterprise-wide deal for 24,000 seats of Microsoft 365 Copilot. Today, about 60% of BlackRock’s Copilot user population is leveraging Copilot on a weekly basis. Additionally, BlackRock also recently made the choice to move its on-prem CRM solution to the cloud with Dynamics 365, citing its native integration with Teams and Outlook as one of its primary decision-making factors.

Strength in security

We know that the threat landscape is rapidly evolving, and it’s imperative that we stay ahead of bad actors. At Microsoft we believe that security is a team sport, and we are stronger when we partner as a security community to share information, collaborate and stop bad actors.

In that spirit, and as part of our Secure Future Initiative (SFI), at Ignite we are announcing the largest public security research event in history: the Zero Day Quest. This event, which focuses on AI and cloud security, will offer the largest award pool in the industry at $4 million, in addition to our existing $16 million annual bounty program. This competition aims to attract the world’s best security minds to tackle high-impact scenarios critical to our customers’ security, with award multipliers, starting today.

As the threat landscape has changed, we have seen rapid evolution in the way attackers exploit weaknesses within systems — particularly by navigating graph relationships between identities, files and devices to uncover attack paths. Attackers thinking in graphs cause wider damage from the first point of intrusion. Traditional security products, with limited visibility into these graph relationships, are often better suited to protect specific devices or mediums — like laptops or inboxes — rather than the full scope of potential attack surface.

Today’s Microsoft Security Exposure Management launch is a pivotal step in transforming cybersecurity with savvy data and AI-based strategies. The power of incorporating Microsoft graph data, in context with data from customers’ other third-party security tools, creates a powerful single pane of glass to visualize attack paths before threat actors do. With computing power and cloud-scale performance to distill powerful real-time mapping of assets and evolving risks, Exposure Management assists security teams in preventing intrusions and provides IT, operations and risk leaders with real-time data to support cyber risk decision-making.

This is only a small section of the many exciting features and updates we will be announcing at Ignite. As a reminder, you can view keynote sessions from Microsoft executives including Satya Nadella, Rajesh Jha, Scott Guthrie, Charlie Bell and Vasu Jakkal, live or on-demand.

Plus, you can get more on all these announcements by exploring the Book of News, the official compendium of all today’s news.

The post Ignite 2024: Why nearly 70% of the Fortune 500 now use Microsoft 365 Copilot appeared first on Microsoft AI Blogs.

At Microsoft, we remain steadfast in our commitment to security, which continues to be our top priority. Through our Secure Future Initiative (SFI), we’ve dedicated the equivalent of 34,000 full-time engineers to the effort, making it the largest cybersecurity engineering project in history—driving continuous improvement in our cyber resilience. In our latest update, we share insights into the work we are doing in culture, governance, and cybernorms to promote transparency and better support our customers in this new era of security. For each engineering pillar, we provide details on steps taken to reduce risk and provide guidance so customers can do the same.

Insights gained from SFI help us continue to harden our security posture and product development. At Microsoft Ignite 2024, we are pleased to unveil new security solutions, an industry-leading bug bounty program, and innovations in our AI platform. 

Transforming security with graph-based posture management 

Microsoft’s Security Fellow and Deputy Chief Information Security Office (CISO) John Lambert says, “Defenders think in lists, cyberattackers think in graphs. As long as this is true, attackers win,” referring to cyberattackers’ relentless focus on the relationships between things like identities, files, and devices. Exploiting these relationships helps criminals and spies do more extensive damage beyond the point of intrusion. Poor visibility and understanding of relationships and pathways between entities can limit traditional security solutions to defending in siloes, unable to detect or disrupt advanced persistent threats (APTs).

We are excited to announce the general availability of Microsoft Security Exposure Management. This innovative solution dynamically maps changing relationships between critical assets such as devices, data, identities, and other connections. Powered by our security graph, and now with third-party connectors for Rapid 7, ServiceNow, Qualys, and Tenable in preview, Exposure Management provides customers with a comprehensive, dynamic view of their IT assets and potential cyberattack paths. This empowers security teams to be more proactive with an end-to-end exposure management solution. In the constantly evolving cyberthreat landscape, defenders need tools that can quickly identify signal from noise and help prioritize critical tasks.  

Beyond seeing potential cyberattack paths, Exposure Management also helps security and IT teams measure the effectiveness of their cyber hygiene and security initiatives such as zero trust, cloud security, and more. Currently, customers are using Exposure Management in more than 70,000 cloud tenants to proactively protect critical entities and measure their cybersecurity effectiveness.

Announcing $4 million AI and cloud security bug bounty “Zero Day Quest” 

Born out of our Secure Future Initiative commitments and our belief that security is a team sport, we also announced Zero Day Quest, the industry’s largest public security research event. We have a long history of partnering across the industry to mitigate potential issues before they impact our customers, which also helps us build more secure products by default and by design.  

Every year our bug bounty program pays millions for high-quality security research with over $16 million awarded last year. Zero Day Quest will build on this work with an additional $4 million in potential rewards focused on cloud and AI—— which are areas of highest impact to our customers. We are also committed to collaborating with the security community by providing access to our engineers and AI red teams. The quest starts now and will culminate in an in-person hacking event in 2025.

As part of our ongoing commitment to transparency, we will share the details of the critical bugs once they are fixed so the whole industry can learn from them—after all, security is a team sport. 

New advances for securing AI and new skills for Security Copilot 

AI adoption is rapidly outpacing many other technologies in the digital era. Our generative AI solution, Microsoft Security Copilot, continues to be adopted by security teams to boost productivity and effectiveness. Organizations in every industry, including National Australia Bank, Intesa Sanpaolo, Oregon State University, and Eastman are able to perform security tasks faster and more accurately.² A recent study found that three months after adopting Security Copilot, organizations saw a 30% reduction in their mean time to resolve security incidents. More than 100 partners have integrated with Security Copilot to enrich the insights with ecosystem data. New Copilot skills are now available for IT admins in Microsoft Entra and Microsoft Intune, data security and compliance teams in Microsoft Purview, and security operations teams in the Microsoft Defender product family.   

According to our Security for AI team’s new “Accelerate AI transformation with strong security” white paper, we found that over 95% of organizations surveyed are either already using or developing generative AI, or they plan to do so in the future, with two thirds (66%) choosing to develop multiple AI apps of their own. This fast-paced adoption has led to 37 new AI-related bills passed into law worldwide in 2023, reflecting a growing international effort to address the security, safety, compliance, and transparency challenges posed by AI technologies.³ This underscores the criticality of securing and governing the data that fuels AI. Through Microsoft Defender, our customers have discovered and secured more than 750,000 generative AI app instances and Microsoft Purview has audited more than a billion Copilot interactions.⁴  

Microsoft Purview is already helping thousands of organizations, such as Cummins, KPMG, and Auburn University, with their AI transformation by providing data security and compliance capabilities across Microsoft and third-party applications. Now, we’re announcing new capabilities in Microsoft Purview to discover, protect, and govern data in generative AI applications. Available for preview, new capabilities in Purview include Data Loss Prevention (DLP) for Microsoft 365 Copilot, prevention of data oversharing in AI apps, and detection of risky AI use such as malicious intent, prompt injections, and misuse of protected materials. Additionally, Microsoft Purview now includes Data Security Posture Management (DSPM) that gives customers a single pane of glass to proactively discover data risks, such as sensitive data in user prompts, and receive recommended actions and insights for quick responses during incidents. For more details, read the blog on Tech Community. 

Microsoft continues to innovate on our end-to-end security platform to help defenders make the complex simpler, while staying ahead of cyberthreats and enabling their AI transformation. At the same time, we are continuously improving the safety and security of our cloud services and other technologies, including these recent steps to make Windows 11 more secure. 

Next steps with Microsoft Security

From the advances announced to our daily defense of customers, and the steadfast dedication of Chief Executive Officer (CEO) Satya Nadella and every employee, security remains our top priority at Microsoft as we deliver on our principles of secure by design, secure by default, and secure operations. To learn more about our vision for the future of security, tune in to the Microsoft Ignite keynote. 

Microsoft Ignite 2024

Gain insights to keep your organizations safer with an AI-first, end-to-end cybersecurity approach.

Register now

Are you a regular user of Microsoft Security products? Review your experience on Gartner Peer Insights™ and get a $25 gift card. To learn more about Microsoft Security solutions, visit our website. Bookmark the Security blog to keep up with our expert coverage on security matters. Also, follow us on LinkedIn (Microsoft Security) and X (@MSFTSecurity) for the latest news and updates on cybersecurity. 

¹ Microsoft Digital Defense Report 2024.

² Microsoft customer stories:

• National Australia Bank invests in an efficient, cloud-managed future with Windows 11 Enterprise
• Intesa Sanpaolo accrues big cybersecurity dividends with Microsoft Sentinel, Copilot for Security
• Oregon State University protects vital research and sensitive data with Microsoft Sentinel and Microsoft Defender
• Eastman catalyzes cybersecurity defenses with Copilot for Security

³ How countries around the world are trying to regulate artificial intelligence, Theara Coleman, The Week US. July 4, 2023.

⁴ Earnings Release FY25 Q1, Microsoft. October 30, 2024.

The post AI innovations for a more secure future unveiled at Microsoft Ignite appeared first on Microsoft AI Blogs.

This week we’re announcing news and advancements to showcase our commitment to your success in this dynamic era. Let’s get started.

Introducing Microsoft Azure AI Foundry: A unified platform to design, customize, and manage AI solutions 

Every new generation of applications brings with it a changing set of needs, and just as web, mobile, and cloud technologies have driven the rise of new application platforms, AI is changing how we build, run, govern, and optimize applications. According to a Deloitte report, nearly 70% of organizations have moved 30% or fewer of their Generative AI experiments into production—so there is a lot of innovation and results ready to be unlocked. Business leaders are looking to reduce the time and cost of bringing their AI solutions to market while continuing to monitor, measure, and evaluate their performance and ROI.

This is why we’re excited to unveil Azure AI Foundry today as a unified application platform for your entire organization in the age of AI. Azure AI Foundry helps bridge the gap between cutting-edge AI technologies and practical business applications, empowering organizations to harness the full potential of AI efficiently and effectively.

We’re unifying the AI toolchain in a new Azure AI Foundry SDK that makes Azure AI capabilities accessible from familiar tools, like GitHub, Visual Studio, and Copilot Studio. We’ll also evolve Azure AI Studio into an enterprise-grade management console and portal for Azure AI Foundry.

Azure AI Foundry is designed to empower your entire organization—developers, AI engineers, and IT professionals—to customize, host, run, and manage AI solutions with greater ease and confidence. This unified approach simplifies the development and management process, helping all stakeholders focus on driving innovation and achieving strategic goals.

For developers, Azure AI Foundry delivers a streamlined process to swiftly adapt the latest AI advancements and focus on delivering impactful applications. Developers will also find an enhanced experience, with access to all existing Azure AI Services, and tooling along with new capabilities we’re announcing today. 

For IT professionals and business leaders, adopting AI technologies raises important questions about measurability, ROI, and ongoing optimization. There’s a pressing need for tools that provide clear insights into AI initiatives and their impact on the business. Azure AI Foundry enables leaders to measure their effectiveness, align them with organizational goals, and more confidently invest in AI technologies.

To help you scale AI adoption in your organization, we’re introducing comprehensive guidance for AI adoption and architecture within Azure Essentials so you are equipped to successfully navigate the pace of AI innovation. Azure Essentials gives you access to Microsoft’s best practices, product experiences, reference architectures, skilling, and resources into a single destination. It’s a great way to benefit from all we’ve learned and the approach you’ll find aligns directly with how to make the most of Azure AI Foundry.

In a market flooded with disparate technologies and choices, we created Azure AI Foundry to thoughtfully address diverse needs across an organization in the pursuit of AI transformation. It’s not just about providing advanced tools, though we have those, too. It’s about fostering collaboration and alignment between technical teams and business strategy.

Now, let’s dive into additional updates designed to enhance the overall experience and efficiency throughout the AI development process, no matter your role.

Introducing Azure AI Agent Service to automate business processes and help you focus on your most strategic work  

AI agents have huge potential to autonomously perform routine tasks, boosting productivity and efficiency, all while keeping you at the center. We’re introducing Azure AI Agent Service to help developers orchestrate, deploy, and scale enterprise AI-powered apps to automate business processes. These intelligent agents handle tasks independently, involving human users for final review or action, ensuring your team can focus on your most strategic initiatives. 

A standout feature of Agent Service is the ability to easily connect enterprise data for grounding, including Microsoft SharePoint and Microsoft Fabric, and tools integration to automate actions. With features like bring your own storage (BYOS) and private networking, it ensures data privacy and compliance, helping organizations protect their sensitive data. This allows your business to leverage existing data and systems to create powerful and secure agentic workflows.

Enhanced observability and collaboration with a new management center experience

To support the development and governance of generative AI apps and fine-tuned models, today we’re unveiling a new management center experience right in Azure AI Foundry portal. This feature brings essential subscription information, such as connected resources, access privileges, and quota usage, into one pane of glass. This can save development teams valuable time and facilitate easier security and compliance workflows throughout the entire AI lifecycle. 

Expanding our AI model catalog with more specialized solutions and customization options 

From generating realistic images to crafting human-like text, AI models have immense potential, but to truly harness their power, you need customized solutions. Our AI model catalog is designed to provide choice and flexibility and ensure your organization and developers have what they need to explore what AI models can do to advance your business priorities. Along with the latest from OpenAI and Microsoft’s Phi family of small language models, our model catalog includes open and frontier models. We offer more than 1,800 options and we’re expanding to offer even more tailored and specialized task and industry-specific models.  

We’re announcing additions that include models from Bria, now in preview, and NTT DATA, now generally available. Industry-specific models from Bayer, Sight Machine, Rockwell Automation, Saifr/Fidelity Labs, and Paige.ai are also available today in preview for specialized solutions in healthcare, manufacturing, finance, and more.

We’ve seen Azure OpenAI Service consumption more than double over the past six months, making it clear customers are excited about this partnership and what it offers_². We look forward to bringing more innovation to you with our partners at OpenAI, starting with new fine-tuning capabilities like vision fine-tuning and distillation workflows which allow a smaller model like GPT-4o mini to replicate the behavior of a larger model such as GPT-4o with fine-tuning, capturing its essential knowledge and bringing new efficiencies.

Along with unparalleled model choice, we equip you with essential tools like benchmarking, evaluation, and a unified model inference API so you can explore, compare, and select the best model for your needs without changing a line of code. This means you can easily swap out models without the need to recode as new advancements emerge, ensuring you’re never locked into a single model.

New collaborations to streamline model customization process for more tailored AI solutions

We’re announcing collaborations with Weights & Biases, Gretel, Scale AI, and Statsig to accelerate end-to-end AI model customization. These collaborations cover everything from data preparation and generation to training, evaluation, and experimentation with fine-tuned models. 

The integration of Weights & Biases with Azure will provide a comprehensive suite of tools for tracking, evaluating, and optimizing a wide range of models in Azure OpenAI Service, including GPT-4, GPT-4o, and GPT-4o-mini. This ensures organizations can build AI applications that are not only powerful, but also specifically tailored to their business needs.  

The collaborations with Gretel and Scale AI aim to help developers remove data bottlenecks and make data AI-ready for training. With Gretel Azure OpenAI Service integration, you can upload Gretel generated data to Azure OpenAI Service to fine-tune AI models and achieve better performance in domain-specific use cases. Our Scale AI partnership will also help developers with expert feedback, data preparation, and support for fine-tuning and training models. 

The Statsig collaboration enables you to dynamically configure AI applications and run powerful experiments to optimize your models and applications in production. 

More RAG performance with Azure AI Search 

Retrieval-augmented generation, or RAG, is important for ensuring accurate, contextual responses and reliable information. Azure AI Search now features a generative query engine built for high performance (for select regions). Query rewriting, available in preview, transforms and creates multiple variations of a query using an SLM-trained (Small Language Model) on data typically seen in generative AI applications. In addition, semantic ranker has a new reranking model, trained with insights gathered from customer feedback and industry market trends from over a year.  

With these improvements, we’ve shattered our own performance records—our new query engine delivers up to 12.5% better relevance, and is up to 2.3 times faster than last year’s stack. Customers can already take advantage of better RAG performance today, without having to configure or customize any settings. That means improved RAG performance is delivered out of the box, with all the hard work done for you.

Effortless RAG with GitHub models and Azure AI Search—just add data 

Azure AI Search will soon power RAG in GitHub Models, offering you the same easy access glide path to bring RAG to your developer environment in GitHub Codespaces. In just a few clicks, you can experiment with RAG and your data. Directly from the playground, simply upload your data (just drag and drop), and a free Azure AI Search index will automatically be provisioned. 

Once you’re ready to build, copy/paste a code snippet into your dev environment to add more data or try out more advanced retrieval methods offered by Azure AI Search. 

This means you can unlock a full-featured knowledge retrieval system for free, without ever leaving your code. Just add data.

Advanced vector search and RAG capabilities now integrated into Azure Databases  

Vector search and RAG are transforming AI application development by enabling more intelligent, context-aware systems. Azure Databases now integrates innovations from Microsoft Research—DiskANN and GraphRAG—to provide cost-effective, scalable solutions for these technologies.

GraphRAG, available in preview in Azure Database for PostgreSQL, offers advanced RAG capabilities, enhancing large language models (LLMs) with your private PostgreSQL datasets. These integrations help empower developers, IT pros, and AI engineers alike, to build the next generation of AI applications efficiently and at cloud scale. 

DiskANN, a state-of-the-art suite of algorithms for low-latency, highly scalable vector search, is now generally available in Azure Cosmos DB and in preview for Azure Database for PostgreSQL. It’s also combined with full-text search to power Azure Cosmos DB hybrid search, currently in preview.  

Equipping you with responsible AI tooling to help ensure safety and compliance  

We continue to back up our Trustworthy AI commitments with tools you can use, and today we’re announcing two more: AI reports and risk and safety evaluations for images. These updates help ensure your AI applications are not only innovative, but safe and compliant. AI reports enable developers to document and share the use case, model card, and evaluation results for fine-tuned models and generative AI applications. Compliance teams can easily review, export, approve, and audit these reports across their organization, streamlining AI asset tracking, and governance. 

We are also excited to announce new collaborations with Credo AI and Saidot to support customers’ end-to-end AI governance. Credo AI pioneered a responsible AI platform enabling comprehensive AI governance, oversight, and accountability. Saidot’s AI Governance Platform helps enterprises and governments manage risk and compliance of their AI-powered systems with efficiency and high quality. By integrating the best of Azure AI with innovative AI governance solutions, we hope to provide our customers with choice and foster greater cross-functional collaboration to align AI solutions with their own principles and regulatory requirements.   

Transform unstructured data into multimodal app experiences with Azure AI Content Understanding  

AI capabilities are quickly advancing and expanding beyond traditional text to better reflect content and input that matches our real world. We’re introducing Azure AI Content Understanding to make it faster, easier, and more cost-effective to build multimodal applications with text, audio, images, and video. Now in preview, this service uses generative AI to extract information into customizable structured outputs.  

Pre-built templates offer a streamlined workflow and opportunities to customize outputs for a wide range of use-cases—call center analytics, marketing automation, content search, and more. And, by processing data from multiple modalities at the same time, this service can help developers reduce the complexities of building AI applications while keeping security and accuracy at the center.

Advancing the developer experience with new AI capabilities and a personal guide to Azure 

As a company of developers, we always keep the developer community top of mind with every advancement we bring to Azure. We strive to offer you the latest tech and best practices that boost impact, fit the way you work, and improve the development experience as you build AI apps. 

We’re introducing two offerings in Azure Container Apps to help transform how AI app developers work: serverless GPUs, now in preview, and dynamic sessions, available now.  

With Azure Container Apps serverless GPUs—you can seamlessly run your customer AI models on NVIDIA GPUs. This feature provides serverless scaling with optimized cold start, per-second billing, with built-in scale down to zero when not in use, and reduced operational overhead. It supports easy real-time inferencing for custom AI models, allowing you to focus on your core AI code without worrying about managing GPU infrastructure. 

Azure Container Apps dynamic sessions—offer fast access to secure sandboxed environments. These sessions are perfect for running code that requires strong isolation, such as large language model (LLM) generated code or extending and customizing software as a service (SaaS) apps. You can mitigate risks, leverage serverless scale, and reduce operational overhead in a cost-efficient manner. Dynamic sessions come with a Python code interpreter pre-installed with popular libraries, making it easy to execute common code scenarios without managing infrastructure or containers. 

These new offerings are part of our ongoing work to put Azure’s comprehensive dev capabilities within easy reach. They come right on the heels of announcing the preview of GitHub Copilot for Azure, which is like having a personal guide to Azure. By integrating with tools you already use, GitHub Copilot for Azure enhances Copilot Chat capabilities to help manage resources and deploy applications and the “@azure” command provides personalized guidance without ever leaving the code.

Updates to our intelligent data platform and Microsoft Fabric help propel AI innovation through your unique data  

While AI capabilities are remarkable, even the most powerful models don’t know your specific business. Unlocking AI’s full value requires integrating your organization’s unique data—a modern, fully integrated data estate forms the bedrock of innovation. Fast and reliable access to high-quality data becomes critical as AI applications handle increasing volumes of data requests. This is why we believe in the power of our Intelligent Data Platform as an ideal data and AI foundation for every organization’s success, today and tomorrow.   

To help meet the need for high-quality data in AI applications, we’re pleased to announce that Azure Managed Redis is now in preview. In-memory caching helps boost app performance by reducing latency and offloading traffic from databases. This new service offers up to 99.999% availability³ and comprehensive support—all while being more cost-effective than the current offering. The best part? Azure Managed Redis goes beyond standard caching to optimize AI app performance and works with Azure services. The latest Redis innovations, including advanced search capabilities and support for a variety of data types, are accessible across all service tiers_⁴.  

Just about a year ago we introduced Microsoft Fabric as our end-to-end data analytics platform that brought together all the data and analytics tools that organizations needed to empower data and business professionals alike to unlock the potential of their data and lay the foundation for the era of AI.​ Be sure to check out Arun Ulag’s blog today to learn all about the new Fabric features and integrations we’re announcing this week to help prepare your organization for the era of AI with a single, AI-powered data platform—including the introduction of Fabric Databases.  

How will you create the future? 

As AI transforms industries and unveils new opportunities, we’re committed to providing practical solutions and powerful innovation to empower you to thrive in this evolving landscape. Everything we’re delivering today reflects our dedication to meeting the real-world needs of both developers and business leaders, ensuring every person and every organization can harness the transformative power of AI.  

With these tools at your disposal, I’m excited to see how you’ll shape the future. Have a great Ignite week! 

Make the most of Ignite 2024 

• Read our Ignite announcements on how to scale your AI transformation with a powerful, secure, and adaptive cloud infrastructure.

• Tune in for can’t-miss sessions at Ignite 2024:
  • Microsoft Ignite Keynote with Satya Nadella and Microsoft leaders.
  • Empowering your AI Ambitions with Azure.
  • Azure AI unlocking the AI revolution.
  • Microsoft Fabric What’s new and what’s next.
  • Trustworthy AI Future trends and best practices.

• Do a deep dive on all the product innovation rolling out this week over on Tech Community. 

• Check out the Master GenAI Model Selection, Evaluation, and Multimodal Integration with Azure AI Foundry Plan on Microsoft Learn. With this outcome-based skilling plan, you can explore the process of selecting and applying GenAI models, how to benchmark and apply multimodal models, and complete evaluations to ensure performance and safety.

• Find out how we’re making it easy to discover, buy, deploy, and manage cloud and AI solutions via the Microsoft commercial marketplace, and get connected to vetted partner solutions today. 

• We’re here to help. Check out Azure Essentials guidance for a comprehensive framework to navigate this complex landscape, and ensure your AI initiatives not only succeed but become catalysts for innovation and growth.

References

^{1. Four futures of generative AI in the enterprise: Scenario planning for strategic resilience and adaptability.}

^{2. Microsoft Fiscal Year 2025 First Quarter Earnings Conference Call.}

^{2. Up to 99.999% uptime SLA is planned for the General Availability of Azure Managed Redis.}

^{3. B0, B1 SKU options, and Flash Optimized tier, may not have access to all features and capabilities.}

The post The next wave of Azure innovation: Azure AI Foundry, intelligent data, and more appeared first on Microsoft AI Blogs.

From agile startups to multinational corporations, Microsoft’s infrastructure offers more choice in performance, power, and cost efficiency so that our customers can continue to innovate. At Microsoft Ignite, we’re introducing significant updates across our entire cloud and AI infrastructure, from advancements in chips and liquid cooling, to new data integrations, and more flexible cloud deployments.

Unveiling the latest silicon updates across Azure infrastructure

As part of our systems approach in optimizing every layer in our infrastructure, we continue to combine the best of industry and innovate from our own unique perspectives. In addition to Azure Maia AI accelerators and Azure Cobalt central processing units (CPUs), Microsoft is expanding our custom silicon portfolio to further enhance our infrastructure to deliver more efficiency and security. Azure Integrated HSM (hardware security module) is our newest in-house security chip, which is a dedicated hardware security module that hardens key management to allow encryption and signing keys to remain within the bounds of the HSM, without compromising performance or increasing latency. Azure Integrated HSM will be installed in every new server in Microsoft’s datacenters starting next year to increase protection across Azure’s hardware fleet for both confidential and general-purpose workloads.

We are also introducing Azure Boost DPU, our first in-house DPU designed for data-centric workloads with high efficiency and low power, capable of absorbing multiple components of a traditional server into a single dedicated silicon. We expect future DPU equipped servers to run cloud storage workloads at three times less power and four times the performance compared to existing servers.

We also continue to advance our cooling technology for GPUs and AI accelerators with our next generation liquid cooling “sidekick” rack (heat exchanger unit) supporting AI systems comprised of silicon from industry leaders as well as our own. The unit can be retrofitted into Azure datacenters to support cooling of large-scale AI systems, such as ones from NVIDIA including GB200 in our AI Infrastructure.

In addition to cooling, we are optimizing how we deliver power more efficiently to meet the evolving demands of AI and hyperscale systems. We have collaborated with Meta on a new disaggregated power rack design, aimed at enhancing flexibility and scalability as we bring in AI infrastructure into our existing datacenter footprint. Each disaggregated power rack will feature 400-volt DC power that enables up to 35% more AI accelerators in each server rack, enabling dynamic power adjustments to meet the different demands of AI workloads. We are open sourcing these cooling and power rack specifications through the Open Compute Project so that the industry can benefit. 

Azure’s AI infrastructure builds on this innovation at the hardware and silicon layer to power some of the most groundbreaking AI advancements in the world, from revolutionary frontier models to large scale generative inferencing. In October, we announced the launch of the ND H200 V5 Virtual Machine (VM) series, which utilizes NVIDIA’s H200 GPUs with enhanced memory bandwidth. Our continuous software optimization efforts across these VMs means Azure delivers performance improvements generation over generation. Between NVIDIA H100 and H200 GPUs that performance improvement rate was twice that of the industry, demonstrated across industry benchmarking.

We are also excited to announce that Microsoft is bringing the NVIDIA Blackwell platform to the cloud. We are beginning to bring these systems online in preview, co-validating and co-optimizing with NIVIDIA and other AI leaders. Azure ND GB200 v6 will be a new AI optimized Virtual Machines series and combines the NVIDIA GB200 NVL 72 rack-scale design with state-of-the-art Quantum InfiniBand networking to connect tens of thousands of Blackwell GPUs to deliver AI supercomputing performance at scale. 

We are also sharing today our latest advancements in CPU-based supercomputing, the Azure HBv5 virtual machine. Powered by custom AMD EPYC^TM 9V64H processors only available on Azure, these VMs will be up to eight times faster than the latest bare-metal and cloud alternatives on a variety of HPC workloads, and up to 35 times faster than on-premises servers at the end of their lifecycle. These performance improvements are made possible by 7 TB/s of memory bandwidth from high bandwidth memory (HBM) and the most scalable AMD EPYC server platform to date. Customers can now sign up for the preview of HBv5 virtual machines, which will begin in 2025. 

Accelerating AI innovation through cloud migration and modernization 

To get the most from AI, organizations need to integrate data residing in their critical business applications. Migrating and modernizing these applications to the cloud helps enable that integration and paves the path to faster innovation while delivering improved performance and scalability. Choosing Azure means selecting a platform that natively supports all the mission-critical enterprise applications and data you need to fully leverage advanced technologies like AI. This includes your workloads on SAP, VMware, and Oracle, as well as open-source software and Linux.

For example, thousands of customers run their SAP ERP applications on Azure and we are bringing unique innovation to these organizations such as the integration between Microsoft Copilot and SAP’s AI assistant Joule. Companies like L’Oreal, Hilti, Unilever, and Zeiss have migrated their mission-critical SAP workloads to Azure so they can innovate faster. And since the launch of Azure VMware Solution, we’ve been working to support customers globally with geographic expansion. Azure VMware Solution is now available in 33 regions, with support for VMware VCF portable subscriptions. 

We are also continually improving Oracle Database@Azure to better support the mission-critical Oracle workloads of our enterprise customers. Customers like The Craneware Group and Vodafone have adopted Oracle Database@Azure to benefit from its high performance and low latency, which allows them to focus on streamlining their operations and to get access to advanced security, data governance, and AI capabilities in the Microsoft Cloud. We’re announcing today Microsoft Purview supports Oracle Database@Azure for comprehensive data governance and compliance capabilities that organizations can use to manage, secure, and track data across Oracle workloads.  

Additionally, Oracle and Microsoft plan to provide Oracle Exadata Database Service on Exascale Infrastructure in Oracle Database@Azure for hyper-elastic scaling and pay-per-use economics. Additionally, we’ve expanded the availability of Oracle Database@Azure to a total of nine regions and enhanced Microsoft Fabric integration with Open Mirroring capabilities. 

To make it easier to migrate and modernize your applications to the cloud, starting today, you can assess your application’s readiness for Azure using Azure Migrate. The new application aware method provides technical and business insights to help you migrate entire application with all dependencies as one.

Optimizing your operations with an adaptive cloud for business growth

Azure’s multicloud and hybrid approach, or adaptive cloud, integrates separate teams, distributed locations, and diverse systems into a single model for operations, security, applications, and data. This allows organizations to utilize cloud-native and AI technologies to operate across hybrid, multicloud, edge, and IoT environments. Azure Arc plays an important role in this approach by extending Azure services to any infrastructure and supporting organizations with managing their workloads and operating across different environments. Azure Arc now has over 39,000 customers across every industry, including La Liga, Coles, and The World Bank.

We’re excited to introduce Azure Local, a new, cloud-connected, hybrid infrastructure offering provisioned and managed in Azure. Azure Local brings together Azure Stack capabilities into one unified platform. Powered by Azure Arc, Azure Local can run containers, servers and Azure Virtual Desktop on Microsoft-validated hardware from Dell, HPE, Lenovo, and more. This unlocks new possibilities to meet custom latency, near real-time data processing, and compliance requirements. Azure Local comes with enhanced default security settings to protect your data and flexible configuration options, like GPU-enabled servers for AI inferencing.

We recently announced the general availability of Windows Server 2025, with new features that include easier upgrades, advanced security, and capabilities that enable AI and machine learning. Additionally, Windows Server 2025 is previewing a hotpatching subscription option enabled by Azure Arc that will allow organizations to install updates with fewer restarts—a major time saver.

We’re also announcing the preview of SQL Server 2025, an enterprise AI-ready database platform that leverages Azure Arc to deliver cloud agility anywhere. This new version continues its industry-leading security and performance and has AI built-in, simplifying AI application development and retrieval augmented generation (RAG) patterns with secure, performant, and easy-to-use vector support. With Azure Arc, SQL Server 2025 offers cloud capabilities to help customers better manage, secure, and govern SQL estate at scale across on-premises and cloud.

Transform with Azure infrastructure to achieve cloud and AI success

Successful transformation with AI starts with a powerful, secure, and adaptive infrastructure strategy. And as you evolve, you need a cloud platform that adapts and scales with your needs. Azure is that platform, providing the optimal environment for integrating your applications and data so that you can start innovating with AI. As you design, deploy, and manage your environment and workloads on Azure, you have access to best practices and industry-leading technical guidance to help you accelerate your AI adoption and achieve your business goals. 

Jumpstart your AI journey at Microsoft Ignite

Key sessions at Microsoft Ignite

• BRK214: Operate infrastructure across distributed locations with Azure Arc.
• BRK 224: Specialized silicon and hardware optimized for cloud infrastructure.
• BRK239: Application centric assessment and guided migration with Azure Migrate.

Discover more announcements at Microsoft Ignite

• Discover the next wave of Azure innovation: Azure AI Foundry, intelligent data, and more.
• Accelerate your app innovation with an AI-powered platform.

Resources for AI transformation

• Build your Azure skills with Microsoft Learn.
• Learn how to improve resiliency on Azure.
• Adopt AI best practices with Azure Essentials.

The post Scale your AI transformation with a powerful, secure, and adaptive cloud infrastructure appeared first on Microsoft AI Blogs.

After a successful Early Access Program, we are also excited to announce that Microsoft Copilot Studio autonomous agents are now in preview. Copilot Studio enables more customers and users to build powerful autonomous agents for a multitude of use cases. We’re also introducing major updates to Power Platform to enhance developer capabilities. Finally, we’re sharing streamlined management of security and governance for Microsoft Power Platform, including your agents.

Over the past year, we’ve witnessed how reimagining business processes with Copilot and agents has revolutionized what we build, including intelligent apps and AI agents. Additionally, enhancing efficiency through automation and AI has fundamentally changed how we build, unlocking even more rapid low-code development.

Supercharge business processes with agents: Change what we build

For years, Microsoft Power Platform’s AI-infused low-code capabilities have empowered organizations to create and deploy applications with ease. Now, with Copilot as the new UI for AI, any organization can build powerful agents that augment their workforce and execute business processes right inside Copilot Studio—without any coding. Autonomous agents can work independently, detecting events like an email arriving, and use generative AI to trigger a series of actions. By automating complex tasks, these agents can orchestrate workflows and work unprompted alongside or on behalf of users or entire teams.

Autonomous agents now in preview

Since its debut at Microsoft Ignite 2023, Copilot Studio has transformed how businesses apply AI to common conversational workflows. By enabling users to create custom agents with advanced AI integration, we’re empowering organizations to streamline customer engagement, employee experience, and partner relationships.

And the introduction of autonomous agents (preview) is a game-changer. Agents built in Copilot Studio can now operate independently, dynamically planning and learning from processes, adapting to changing conditions, and making decisions without the need for constant human intervention. These autonomous agents can be triggered by data changes, events, and other background tasks—and not just through chat.

We’re also announcing agent library (preview) so users can get a head start by choosing agents based on commonly used scenarios and autonomous triggers (preview), allowing agents to automatically respond to signals across your business and initiate tasks. These advancements make it easy to automate complex tasks and processes.

Agent builder in Microsoft Power Apps now in preview

We’re also announcing the preview of agent builder in Power Apps, enabling organizations to rapidly transition into the AI-first era. By using existing knowledge, logic, and actions already built into the apps they create, makers can develop agents to handle tasks autonomously, eliminating repetitive processes, redefining individual productivity, and improving overall business efficiency.

Stories and benefits from the Copilot Studio autonomous agent Early Access Program

Autonomous agents are expanding the boundaries of what’s possible, enabling the creation of innovative applications and solutions that drive significant business outcomes:

• Accenture, a leading global professional services company that specializes in IT services and management consulting, has created agents to simplify complex operations and boost customer satisfaction.

“Accenture joined Microsoft Copilot Studio’s Early Access Program on autonomous agents and tapped into our deep industry and functional expertise to swiftly create high-impact, agent-driven use cases that drive workforce efficiency and enhance customer experiences. We developed nine powerful agents for Business Operations and Industry, positioned to increase operational efficiency by 40%, raise customer satisfaction scores by 10% to 20%, and lower costs by 15%. The simplicity of Copilot Studio’s agentic platform, ease of use, and configurability played a critical role in our success.”

—Rich Holsman, Senior Managing Director of Global Data and AI, Accenture

• Pets at Home, a leading pet care business in the United Kingdom, has used Copilot Studio to create autonomous agents for specific business workflows. One agent that was created for the profit protection team enabled more efficient case compilation for human review, potentially saving seven figures annually.

“We’re using AI to do the time-consuming work so our colleagues can use all resource and expertise to make decisions quickly based on large amounts of data. It’s truly helped empower colleagues through both the level of information at their fingertips, and in time spent on more nuanced and insightful work. The agent solution allows the profit protection team to more effectively assess cases for potential profit loss and dedicate more of their time to skilled analysis, rather than simply information gathering.”

—William Hewish, Chief Information Officer, Pets at Home

Enhance efficiency with AI in low-code: Change how we build

Microsoft Power Platform has always been focused on enabling rapid development of solutions. With Copilot, that is truer than ever. It is increasingly possible to use natural language, images, and documents to develop applications, automations, and more. This will unlock faster development and make Microsoft Power Platform increasingly accessible.

Plan designer in Power Apps now in preview

The new plan designer in Power Apps (preview) is a game-changer, integrating AI-powered assistance directly into the app creation process. Makers can now simply describe their business challenges and provide context like process diagrams, data models, or even screenshots of legacy applications. From there, Copilot will draft user roles and requirements, which can then be refined or modified with AI assistance. Copilot offers real-time suggestions and automation within a single conversational interface, leading makers from problem definition to solution architecture.

Unlock endless possibilities with deeper Microsoft Azure integration

By integrating Copilot Studio with Microsoft Azure AI Foundry Portal, users can bring their own models, prompts, and knowledge, ensuring a smooth and efficient connection with Azure services—without the need for extensive coding.

Copilot Studio pay-as-you-go with your Azure subscription

As accessing Azure AI capabilities in Copilot Studio becomes more common, flexible pricing has become essential. On December 1, 2024, Microsoft will introduce an option to buy Copilot Studio messages with pay-as-you-go consumptive billing through existing Azure subscriptions. This pricing option empowers developers to harness the full potential of Azure AI, while providing the flexibility needed to scale and adapt to changing demands.

Empower administrators with streamlined governance and security

In 2022, we transformed governance with managed environments, empowering tens of millions of citizen developers around the world.

Now, we’re taking it further with managed security and managed operations. These new features bring advanced threat protection, proactive alerts, and seamless disaster recovery to Power Apps, Microsoft Power Automate, Copilot Studio, and Microsoft Dynamics 365. Integrated directly into the reimagined Power Platform admin center, these capabilities ensure your business applications are secure, scalable, and always performing at their best.

Embrace the future of AI-first development

The integration of Copilot and autonomous agents is further revolutionizing development in Microsoft Power Platform. These advancements are not just about automating processes; they are reshaping the landscape of digital innovation. Microsoft Power Platform enables organizations to become AI-first companies—innovating faster, making smarter decisions, and delivering greater value to their customers.

Explore Microsoft Power Platform blogs and sessions for Microsoft Ignite 2024

Copilot Studio introduces autonomous agents, agent library:

• Blog: Learn more about this update
• Breakout: What’s new with Copilot Studio and agents
• Breakout: Extending M365 Copilot with Copilot agents: Best practices
• Breakout: Reinventing business processes with autonomous agents 

Copilot Studio and Azure AI announce new tools for developers:

• Blog: Learn more about this update
• Keynote: Microsoft Ignite Keynote
• Breakout: Better together: Copilot Studio and Azure AI
• Breakout: Developers guide to building your own agents

Copilot Studio enhances platform with new updates:

• Blog: Learn more about this update
• Breakout: What’s new with Copilot Studio and agents
• Breakout: Get the most of your enterprise knowledge with Copilot Studio
• Breakout: Get started with best-in-class Copilot connectors in Copilot Studio
• Breakout: Ground Microsoft 365 Copilot in your business knowledge

New capabilities in Power Apps help leverage AI for business productivity:

• Blog: Learn more about this update
• General session: Unlock the value of Microsoft 365 Copilot and Copilot Studio
• Breakout: The Future of Power Platform: Intelligent Apps
• Breakout: Building intelligent applications with AI and Power Apps
• Breakout: Unlock Productivity with AI in Power Apps
• Breakout: Deep Dive: Create, monitor and optimize enterprise apps with Power Apps
• Theater: Building complete solutions with Copilot and Power Apps

New AI and governance features in Microsoft Power Automate:

• Blog: Learn more about this news
• Breakout: Unlock innovation with practical strategies in Power Automate
• Breakout: Revolutionize the way you work with Power Automate and AI 
• Breakout: Automate email, doc, and image processing with GPT in Power Automate

Power Platform Admin Center simplifies security and governance experience:

• Blog: Learn more about this news
• Breakout: Enterprise Scale: The Future of Power Platform Governance
• Theater: Leveraging rich visibility to secure AI driven business applications
• Theater: Getting the most out of the new Power Platform Admin Center

The post Redefine development: AI-first innovation with agents and Microsoft Copilot in Power Platform appeared first on Microsoft AI Blogs.

With Fabric, we focused on simplicity, openness, and autonomy. All Fabric workloads work together seamlessly out-of-the-box without the myriad of infrastructure and configuration settings you typically find in data platforms so you can focus on getting results. You can ingest structured and unstructured data in any format into OneLake’s open Delta Parquet format and even access third-party tools from industry leading software companies built directly into Fabric. Advanced security, governance, and continuous integration and continuous delivery (CI/CD) capabilities are woven into the platform with personalized experiences for admins and users alike. Microsoft Copilot and other AI capabilities are built into every layer of Fabric to help data professionals and business users automate routine tasks and get more done. In fact, we’ve found that users were 52% faster in completing standard data analysis tasks and uncovered insights 36% more accurately when using Copilot in Fabric, with 90% saying they were likely to adopt Copilot in Fabric.¹  

Fabric’s vision for a data platform has highly resonated with the industry, and more than 17,000 customers, including 70% of the Fortune 500, are already using Fabric to empower their data teams.

• Melbourne Airport, the second busiest in Australia, used Fabric to analyze their operational data in real-time and gained 30% increased performance efficiency across data-related operations. “It’s a radical and powerful new technology that can feel just like using Microsoft Excel or Power BI. But once in the hands of the user, it doesn’t feel like a new, complex technology at all,” Irfan Khan, Head of Data and Analytics.  
• Chanel, a world leader in luxury fashion, adopted Fabric not only to drive more value from its data and support their AI innovation, but also safeguard its data at rest and in-transit with Fabric’s end-to-end, built-in security, governance, and reliability. “We chose Microsoft Fabric as the foundation of this platform, driven by its ability to implement a data mesh approach,” Olivier Barbonnat, Chief Information Officer Europe.  
• Our own Microsoft IDEAS (insights, data, engineering, analytics, systems) team, one of the largest data teams in the world, transitioned to Fabric to support its AI ambitions. Its solution now encompasses 27,000 data sources, 420 petabytes of data, 35,000 data pipelines, 38,000 semantic models, and more than 600 teams relying on its models. The IDEAS team estimated it has received a 50% efficiency boost from consolidating assets in OneLake, using modern tools such as Spark and Python, Direct Lake mode in Microsoft Power BI, and AI-assisted coding through IDEAS Copilot.

Schaeffler, Hitachi Solutions, KPMG, Epic, and many other customers have seen a transformational impact to how they process data. You can explore all these Fabric stories on the Microsoft Customer Stories page. One of the reasons Fabric caught the imagination of so many is because, with Fabric, you can simplify and future-proof your data estate. Fabric’s capabilities and workloads will continue to expand and be seamlessly infused into our pre-integrated platform, helping you keep up with the technology trends without added work.  

And since launching Fabric, we’ve added new ways to bring data into Fabric with capabilities like mirroring and new shortcut sources. We’ve expanded Copilot in Fabric across almost every experience to help everyone automate routine tasks. We’ve added a multitude of security and governance features to help you make sure your data is secure at every step of its journey. We’ve added the ability to extend Fabric further with native, industry-specific workloads from Microsoft and other software developers. And most impactfully, we launched a new workload to help organizations make better decisions from Internet of Things (IoT), logs, and telemetry data—Real-Time Intelligence.  

With Fabric Real-Time Intelligence, we transformed Fabric into a platform equipped to support your operational scenarios and data in motion. And now, we’re helping you bring transactional scenarios to Fabric with the introduction of Fabric Databases. 

Introducing a unified data platform with Fabric Databases

Currently, the data and AI technology market is massively fragmented with hundreds of vendors and thousands of services. We believe the future of data and AI is the convergence of all your data services into a unified, open, and extensible platform, so you no longer have to manually stitch together disconnected services.  

Today, we’re thrilled to announce a major leap toward this goal with Fabric Databases, now in preview. Fabric Databases represent a new class of cloud databases that brings a world-class transactional database natively to Microsoft Fabric for app developers. With the addition of Fabric Databases, Fabric now brings together both transactional and analytical workloads, creating a truly unified data platform. Developers can streamline application development with simple, autonomous, and AI-optimized databases that provision in seconds and are secured by default with features like cloud authentication and database encryption. Built-in vector search, retrieval augmented generation (RAG) support, and Azure AI integration simplify AI app development, and your data is instantly available in OneLake for advanced analytics. Developers can even use Copilot in Fabric to translate natural language queries into SQL and get inline code completion alongside code fixes and explanations.

SQL database, the first available in Fabric, was built on our industry-leading SQL Server engine and the simple and intuitive SaaS platform of Fabric. In fact, data professionals who’ve tried SQL database in Fabric were able to complete common database tasks up to 71% faster and with 63% more effective task completion. They reported feeling 84% more confident in these tasks and finding the tasks up to 91% less difficult.²  These results were even more pronounced for people who were newer to cloud. Those with less than two years of cloud platform experience benefited the most in terms of efficiency and effectiveness, highlighting the simplicity and intuitiveness of Fabric Databases. 

SQL database is just the beginning for Fabric Databases, with more databases on the roadmap. Whether you’re an experienced data professional or just getting started, you can build AI apps faster and more confidently on Fabric Databases.

To learn more, read the Fabric Databases blog post, watch the Microsoft Mechanics deep dive video, and watch the following sizzle video:

General availability of Fabric Real-Time Intelligence

We’re also thrilled to announce Real-Time Intelligence is now generally available. With Real-Time Intelligence, you get both pro-dev and no-code tools to ingest high-volume streaming data with high granularity, dynamically transform streaming data, query data in real-time for instant insights, and trigger automated actions based on the data. The Real-time hub provides a central place to discover and manage all your streaming data. Dener Motorsport, a participant in the annual Porsche Carrera Cup Brasil event, used Real-Time Intelligence for in-race analytics, and their CEO, Dener Pires, said “Before we used Microsoft Fabric and Real-Time Intelligence, it was probably 30 minutes before the engineers knew that something was wrong with a car, could get the data, analyze it, and provide a solution. Today that process is done in minutes.” Check out this blog post and the following demo to see Real-Time Intelligence in action: 

OneLake catalog—a complete catalog for discovery, management, and governance

No matter what data project you’re trying to accomplish, it starts with the right foundation. OneLake, Fabric’s unified, multi-cloud data lake, is built for everyone in your entire organization as the single point to discover and explore your data. With OneLake shortcuts and mirroring, you can unify all of your multi-cloud and on-premise sources and enable your people to work from the same data—meaning fewer copies of data, better collaboration between your teams, and easier, more streamlined analysis. And since data is stored in an open format, you can use data in OneLake for all your data projects, no matter the vendor or service.  

Today, we’re excited to announce the OneLake catalog, a complete solution to explore, manage, and govern your entire Fabric data estate. The OneLake catalog comes with two tabs, Explore and Govern, that can help all Fabric users discover and manage trusted data, as well as provide governance for data owners with valuable insights, recommended actions, and tooling. Since the OneLake catalog is an evolution of the OneLake data hub, it already shows up in Microsoft 365, such as in Excel and Microsoft Teams and many other products in the Microsoft cloud for easy data consumption. OneLake catalog value can be extended to the Microsoft Purview data governance solution, Unified Catalog, which offers the data office, data stewards, and data owners advanced governance capabilities, including data quality and a global catalog for the heterogeneous data estate. The Explore tab is now generally available, and the Govern tab will be coming soon in preview.  

Learn more about the OneLake catalog by reading this blog post and by watching the following demo:

More Fabric innovation

The introduction of Fabric Databases and the growing opportunity with generative AI in accelerating data projects has encouraged us to reimagine the pillars of Fabric. We are now focused on making sure Fabric can provide you with: 

• An AI-powered data platform. Fabric can give your teams the AI-powered tools needed for any data project in a pre-integrated and optimized SaaS environment. You can even extend Fabric further by adding other native workloads from the Workload Hub, created by industry-leading partners.  
• An open and AI-ready data lake. Fabric can help you access your entire multi-cloud data estate from a single data lake, work from the same copy of data across analytics engines, and ensure your data is ready to power AI innovation.  
• AI-enabled business users. Fabric can empower everyone to better understand your data with AI-enhanced Q&A experiences and visuals embedded in the Microsoft 365 apps they use every day. 
• A mission-critical foundation. You can confidently deploy and manage Fabric with category-leading performance, instant scalability, shared resilience, and built-in security, governance, and compliance. 

Check out the new Fabric sizzle video to see these pillars in action: 

We’re excited to share a huge slate of announcements designed to help us better accomplish each goal above. These enhancements include: 

Fabric workload enhancements

• The general availability of sustainability data solutions in Microsoft Fabric, a single place for all your environmental, social, and governance (ESG) data needs. Julie Nikulina, IT Solutions Engineer at Schaeffler AG, a global automotive and industrial supplier, mentioned that, “thanks to Microsoft Fabric, we’ll be able to answer lots of questions about climate neutrality and decarbonization company-wide via a single platform—and we can implement new use cases in short sprints within two to six weeks.”  
• Coming soon, the preview of AI functions in Fabric notebooks, which provide a simplified API for common AI text enrichments like summarization, translation, sentiment analysis, and more. 
• The general availability of API for GraphQL, which is an API to help you access data from multiple sources in Fabric with a single query API. 
• The preview of several enhancements to Fabric Real-Time Intelligence, which include new Fabric events, enhancements to Eventstreams and Eventhouses, and easier real-time dashboard sharing. 
• The preview of the Copilot in Fabric experience for data pipelines in Fabric Data Factory. 
• The preview of our integration with Esri ArcGIS for advanced spatial analytics. 

Microsoft OneLake enhancements

• The preview of open mirroring, a feature that allows any application or data provider to write change data directly into a mirrored database within Fabric. 
• The general availability of Azure SQL DB mirroring and the preview of SQL MI mirroring. 

New AI capabilities in Fabric

• Coming soon, the preview of AI skill enhancements, including a more conversational experience and support for semantic models and Eventhouse KQL databases. 
• Coming soon, the preview of AI skill integration with Agent Service in the newly announced Azure AI Foundry, allowing developers to use AI skills as a core knowledge source. 

Platform-wide enhancements

• The preview of workspace monitoring, which provides detailed diagnostic logs for workspaces to troubleshoot performance issues, capacity performance, and data downtime. 
• The general availability of the Workload Development Kit, created to help software developers design, build, and interoperate applications within Fabric. We’re excited to see many of our industry-leading partners announce preview of their workload hub offerings, including Quantexa, SAS, Teradata, Osmos, Esri, and Profisee. 
• The preview of further integration with Microsoft Purview including extending Protection policies to enforce access permissions to more sources and using Data Loss Prevention policies to restrict access to semantic models with sensitive data. 
• The general availability of external data sharing allows you to directly share OneLake tables and folders with other Fabric tenants in an easy, quick, and secure manner. 
• Fabric is FedRAMP High certified for the Azure Commercial cloud, the highest level of compliance and security standards required by the federal government for cloud service providers. Now government agencies can run Fabric on the Azure Commercial cloud while maintaining strict compliance. 

You can learn more about all of these announcements and so much more in the Fabric November 2024 Update blog post and the numerous blog posts that will go live throughout this week on the Fabric blog channel.  

Fabric billing and consumption updates

Finally, we’re making some important changes to Fabric’s billing model. First, coming soon, organizations with multiple capacities can now direct Copilot in Fabric consumption and billing to a specific capacity, no matter where the Copilot in Fabric usage actually takes place. Admins can assign specific members of their organization to the specified F64 or higher capacity for all of their Copilot requests. These requests will be consumed and billed on that assigned F64+ capacity, ensuring Copilot in Fabric usage doesn’t impact priority jobs while expanding Copilot access to any workspace regardless of its capacity.

Additionally, we’re providing capacity admins with more control over the Fabric jobs running in their capacities. Surge protection, now in preview, helps protect capacities from unexpected surges in background workload consumption. Admins can use surge protection to set a limit on background activity consumption, which will prevent background jobs from starting when reached. Admins can configure different limits for each capacity in your organization to give you the flexibility to meet your needs.

Watch Fabric in action at Microsoft Ignite

Join us at Microsoft Ignite 2024 from November 19 to November 21, 2024 to see all of these announcements in action across the following sessions:  

• “Microsoft Fabric: What’s new and what’s next” with Arun Ulagaratchagan and Amir Netz
• “Power AI apps with unified data and insights in Microsoft Fabric” with Panos Antonopoulos, Anna Hoffman, and Asad Khan 
• “Ingest, govern, and secure your data with OneLake” with Josh Caplan, Wilson Lee, and Adi Regev 
• “Unlock the power of Real-Time Intelligence in the era of AI” with Yitzhak Kesselman, Tessa Kloster, Niraj Revankar, Vijay Sankaran, and Ksenia Suresh. 

And six other Fabric breakout sessions. You can also join us at labs and theater sessions throughout the event. Find all the data-related sessions at Ignite. You can also learn about other announcements across our Azure portfolio by reading these blogs by Jessica Hawk and Omar Khan. 

• The next wave of Azure innovation: Azure AI Foundry, intelligent data, and more: We’re bringing a huge range of innovation to our AI platform including the new Azure AI Foundry, a unified platform designed to empower both developers and business decision-makers in the age of AI. 
• Scale your AI transformation with a powerful, secure, and adaptive cloud infrastructure: We’re also announcing cloud and AI infrastructure announcements, from advancements in chips and liquid cooling to new data integrations and more flexible cloud deployments.  

Finally, if you want more strategic guidance to help you along your data and analytics journey in the era of AI, you should watch the recent Data and Analytics Forum.

Getting started with Microsoft Fabric

New customers can try out everything Fabric has to offer by signing up for a free 60-day trial—no credit card information required. Learn how to start your free trial.  

If you’re considering purchasing Fabric and need help deciding on a SKU, we’re excited to share a new Fabric SKU estimator, now in private preview. You can sign up to try out this tool as part of the early adopter program—try the SKU estimator.

Start building your Fabric skills

Be one of the first to start using Fabric Databases

Ready to build reliable, highly scalable applications where cloud authentication and encryption are secured by default? Starting December 3, 2024, join live sessions with database experts and see just how easy it is to get started. View the schedule and register for the series.

Get certified in Microsoft Fabric—for free

Get ready to fast-track your career by earning your Microsoft Certified: Fabric Analytics Engineer Associate certification. For a limited time, we’re offering 5,000 free DP-600 exam vouchers to eligible Fabric community members. Complete your exam by the end of the year and join the ranks of certified experts. Don’t miss this opportunity to get certified. 

A new Fabric certification for data engineers

We’re excited to announce a brand-new certification for data engineers. The new Microsoft Certified: Fabric Data Engineer Associate certification will help you demonstrate your skills with data ingestion, transformation, administration, monitoring, and performance optimization in Fabric. To earn this certification, pass Exam DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric, currently in beta.

Join us at the 2025 Microsoft Fabric Community Conference

Looking to gain hands-on experience with Fabric and learn directly from the people who created it? If so, join us from March 29 to April 3, 2025, at the Microsoft Fabric Community Conference in Las Vegas, Nevada. Register today. 

Explore additional resources for Microsoft Fabric

If you want to learn more about Fabric:  

• Sign up for the Fabric free trial. 
• Register for the Microsoft Data and Analytics Forum. 
• View the updated Fabric Roadmap. 
• Visit the Fabric website. 
• Join the Fabric community. 
• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog. 
• Explore the Fabric technical documentation.

Read additional blogs by industry-leading partners:

• “Data Governance in Microsoft Fabric with Microsoft Purview,” by CloudThat Technologies Pvt. Ltd.
•  “Key Fabric Announcements and Overview of Fabric Databases,” by Telefónica Tech.
• “Architecting tomorrow—A Microsoft Fabric Blueprint to intelligent enterprise covering Fabric Databases, AI Skills, Fabric and Microsoft Purview, Apache Iceberg support in OneLake,” by Avasoft Inc.
• “Microsoft Fabric Databases,” “Microsoft Fabric’s AI Skills,” and “Data Engineering: Liquid Clustering in Fabric,” by Verne Tech.
• “A First Look at Fabric Mirroring for SQL Managed Instance,” by Coeo Ltd.
• “Leveraging Microsoft Fabric for Dynamics 365 with Dataverse,” and “Automating Data Workflows in Microsoft Fabric: A Low-Code/No-Code Approach,” by PreludeSys.
• “Enabling self-service for supply chain analytics with Microsoft Fabric and Direct Lake,” “Transforming data operations with Microsoft Fabric and CI/CD for ISVs,” and “How Microsoft Fabric transformed data analytics for an ISV with Real-Time Intelligence,” by MAQ Software.       

¹Based upon n=209 user studies conducted by Microsoft Corporation in October 2024 that measured four common metrics associated with the consumption experience of Power BI in Microsoft Fabric. Qualitative sentiment gathered upon task completion. The actual results may vary. 

²Based upon n=210 user studies conducted with technical practitioners by Microsoft Corporation in October 2024 that measured time to complete four common tasks associated with AI application development on a SQL database in Microsoft Fabric and on Azure SQL Database. Actual results may vary based upon individual performance and sentiment

The post Accelerate app innovation with an AI-powered data platform appeared first on Microsoft AI Blogs.

Located in Vatican City, St. Peter’s Basilica is over 400 years old, and is one of the most well-known churches in the world revered for its breathtaking Renaissance and Baroque architecture. Famous architects like Michelangelo and Bernini contributed to the design of the church, which took over 100 years to complete.

Today, La Basilica di San Pietro—a collaboration between the Vatican, Iconem, and Microsoft—gives everyone full access to Vatican City’s most iconic church via AI-enabled immersive exhibits and an interactive website.

Making history

Taking photos of every detail of a massive historic cathedral and piecing them all together sounds daunting, especially in less than a month, but with AI, it’s possible. Iconem, a leader in digital preservation based in Paris, uses advanced photogrammetry and AI to create 3D replicas of the world’s most famous historic landmarks and archaeologial sites.

Andrea Louis, software engineer and Technical Project Manager at Iconem, found the La Basilica di San Pietro experience stimulating due to its size and complexity, and the many spiritual, artistic, and historical layers involved. Being inside St. Peter’s Basilica gave her and the Iconem team intimate knowledge of the church, which allowed them to develop new ways to bring visitors inside the space.

It’s like an investigation of the 2,000-year history through one unique monument.

Yves Ubelmann

Founder and CEO of Iconem

To make the 3D version of St. Peter’s Basilica, the Iconem team took over 400,000 high-resolution images using advanced photogrammetry techniques. They spent three weeks scanning the Basilica using various devices including drones, cameras, and lasers, and Azure processed the massive volume of images collected. This data was securely backed up and stored in Azure Cloud, making it accessible to partners. Iconem then created an ultra-precise 3D model, or a digital twin of the Basilica. AI-generated imagery taken from Iconem’s photogrammetry data enhanced visualization of both the interior and exterior of the Basilica, allowing visitors to explore every intricate detail from anywhere in the world.

Bringing it to life with AI

Microsoft provided the AI tech needed to process and analyze Iconem’s vast amount of photogrammetry data used to create the digital twin of St. Peter’s Basilica. Microsoft’s AI for Good Lab contributed advanced tools that refined the digital twin with millimeter-level accuracy, and used AI to help detect and map structural vulnerabilities like cracks and missing mosaic tiles. The Vatican oversaw the collaboration, ensuring the preservation of the Basilica as a cultural, spiritual, and historically significant site for years to come.

An experience of a lifetime

In November 2024, ahead of the the 2025 Holy Year Jubilee, both the public exhibition and digital platforms of St. Peter’s Basilica will be available for everyone to see and experience in the Pétros enì exhibit. The Holy Year Jubilee occurs every 25 years as a year of grace and pilgrimage in the Roman Catholic church. During this time, Catholics are encouraged to take a pilgrimage to Rome where they can participate in ceremonies, religious events, and focus on spiritual renewal. “Pilgrims of Hope” is the theme of the 2025 Holy Year Jubilee.

The Pétros enì exhibit will give the 35 million pilgrims in Rome an immersive, in-person experience of a lifetime, and it will also help more than a billion Catholics unable to make the trip feel like they’re in the moment.

Visit the La Basilica di San Pietro, an AI-enhanced experience

This project ultimately allows us to rediscover what is fully human and connects everyone.

Cardinal Mauro Gambetti

Archpriest of St. Peter’s Basilica

The post Access for all: La Basilica di San Pietro appeared first on Microsoft AI Blogs.