Learn more about FabCon and SQLCon 2026
The excitement surrounding this event reflects the same momentum we’re seeing across our data portfolio. Just two and a half years after Microsoft Fabric reached general availability, it’s already serving more than 31,000 customers and remains the fastest-growing data platform in Microsoft’s history. Fortune 500 companies like The Coca-Cola Company are already using Fabric at scale across their organizations.

Microsoft Fabric is helping us evolve our data foundation into a more unified, AI-ready platform. Combined with Power BI and capabilities like Fabric IQ, it enables the enterprise to turn data into intelligence and act on it faster.

Shekhar Gowda, Vice President of Global Marketing Technologies at The Coca-Cola Company
Our databases are accelerating just as quickly, with SQL Server 2025 growing more than twice as fast as the previous version.

Today, we’re thrilled to share how we are bringing the power of databases and Fabric together to form a truly converged data platform—one that unifies transactional, operational, and analytical data under a single, consistent architecture. I’ll also highlight how we’ve enhanced Fabric to help you transform data into the semantic knowledge AI needs to understand your business, powered by Fabric IQ and Power BI’s industry-leading semantic model technology.

Introducing the Database Hub in Microsoft Fabric
Databases sit at the heart of the enterprise data estate—a system of record powering applications, transactions, and mission‑critical insights. Yet as organizations scale across cloud, on‑premises, and edge environments, database estates have become increasingly fragmented and isolated. As AI places even greater demands on data estates, unifying databases under a single access point and control plane has become essential.

To address this challenge, Fabric is expanding its role as the central access point for enterprise data with the Database Hub in Fabric, now available in early access. Database Hub in Fabric provides a unified database management experience that brings together databases across edge, cloud, and Fabric into a single, coherent view. Teams now have one place to explore, observe, govern, and optimize their entire database estate—including Azure SQL, Azure Cosmos DB, Azure Database for PostgreSQL, SQL Server (enabled by Azure Arc), Azure Database for MySQL, and Fabric Databases—without changing how each service is deployed.

Built for scale, the Database Hub in Fabric introduces an agent‑assisted, human-in-the loop approach to database management. With built-in observability, delegated governance, and Microsoft Copilot-powered insights, teams can deploy intelligent agents to continuously reason over estate‑wide signals and surface what changed, explain why it matters, and guide teams toward what to do next. The result is a simpler, more confident way to manage databases at scale. Over time, this model enables database estates to become more proactive, resilient, and intelligent, laying the foundation for greater autonomy, while keeping humans firmly in control of goals, boundaries, and trust.

Learn more about Database Hub in Fabric and what’s new across Databases
Bringing databases together under a single management layer is a critical step as you prepare your estates for AI at scale. But it’s not the end of the journey. The challenge shifts from where data lives to how data is understood, connected, and activated across the enterprise.

Getting your data estate ready for AI with Fabric
As organizations move from traditional applications to AI‑powered, multi‑agent systems, the advantage is shifting away from the specific model you deploy. It now lies in the intelligence and context that allow agents to understand how your business is run, the state of your business, and your institutional knowledge to help take meaningful action.

This is the challenge Microsoft IQ is designed to address. Unlike point solutions on the market today, Microsoft IQ provides an intelligence layer that delivers shared, enterprise-grade business context to every agent. That context is built from three complementary sources: productivity signals from Work IQ, institutional knowledge from Foundry IQ, and live business data from Fabric IQ.

However, like the database layer, while the IQ context layer is a critical part of a successful, and healthy AI foundation, it is not the full story. Building a complete AI-ready data foundation requires investing in four core steps:

Unifying your data estate to eliminate silos and reduce architectural complexity.
Processing and harmonizing data so it becomes AI-ready, clean, connected, and structured for both operational and analytical use.
Curating semantic meaning to give agents contextual understanding, enabling them to interpret data the way your teams already do. This is where Microsoft IQ comes into play.
Empowering AI agents to act, applying that context to automate workflows, accelerate decisions, and transform operations end‑to‑end.
Unifying your data estate with Microsoft OneLake
Every AI initiative starts with the same fundamental challenge: understanding where your data lives and how to bring it together. Microsoft OneLake was built to solve that problem by unifying data across clouds, on-premises environments, and third-party platforms into a single logical data lake without unnecessary extracting, transforming, and loading (ETL), fragmentation, or duplicated copies.

Are my agents hunting for data?

Watch the podcast
Connecting to more sources than ever before
Today, we’re expanding Mirroring in Fabric to support even more systems our customers rely on. Mirroring for SharePoint lists and Dremio are now in preview with Azure Monitor coming soon, while mirroring for Oracle and SAP Datasphere are generally available—all of which are available as part of the core mirroring capabilities. We are also introducing extended capabilities in mirroring designed to help you operationalize mirrored sources at scale, including Change Data Feed (CDF) and the ability to create views on top of mirrored data, starting with Snowflake. Extended capabilities for mirroring will be offered as a paid option.

Shortcut transformations are also now generally available, allowing data to be shaped automatically as it connects to or moves within OneLake. You can convert formats such as Excel to Delta tables, now in preview, and apply AI-powered transformations.

Additionally, we are continuing to invest in open interoperability, ensuring OneLake works seamlessly with the platforms organizations already use. We are excited to announce the ability to natively read from OneLake through Azure Databricks Unity Catalog is now in public preview. We also recently announced the general availability of our interoperability with Snowflake.

I’m also excited to share that Auger, a rapidly growing supply chain platform designed to bring intelligence and automation to global operations, has built its platform on Fabric, with all data stored natively in OneLake. This architecture enables Auger customers to seamlessly access their operations data through OneLake shortcuts within their own Fabric environments and use the full power of the platform including Power BI, Fabric data agents, and more. Learn more in my blog, co-authored with Auger Chief Executive Officer Dave Clark.

Protect your data with OneLake security, now generally available
Security and governance remain foundational to OneLake. I’m thrilled to announce OneLake security will be generally available in the coming weeks, enabling data owners to define roles, enforce row- and column-level controls, and manage permissions through a single unified model that follows the data.

To learn more about these announcements, read the OneLake blog and the Fabric Data Factory blog.

Processing and harmonizing data with Fabric analytics
AI agents are only as reliable as the data you feed them. Before data can train or ground an agent, it must be integrated, cleaned, and structured, so the agent operates from consistent, trusted information. With industry-leading engines in Fabric like Spark, T-SQL, KQL, and Analysis Services, we can equip data teams to do exactly that.

Now, we are expanding these capabilities with the introduction of Runtime 2.0 in preview, purpose-built for large-scale data computation. It incorporates Apache Spark 4.x, Delta Lake 4.x, Scala 2.13, and Azure Linux Mariner 3.0 to power advanced enterprise workloads. Materialized lake views are also now generally available, simplifying medallion architecture implementation in Spark SQL and PySpark and enabling always up-to-date pipelines with no manual orchestration. In addition, a new agentic Copilot experience in notebooks delivers deeper context awareness, reasoning over your workspace, and generating code with greater speed and precision.

For real-time scenarios, we’re launching Microsoft Fabric Maps into general availability. Maps add geospatial context to your agents and operations by turning large volumes of location-based data into interactive, real-time visual insights.

For a comprehensive overview of these announcements and much more, read the Fabric Analytics announcement blog and the Fabric Real-Time Intelligence announcement blog.

Creating semantic meaning with Fabric IQ
Preparing raw data for AI is essential. The next step is transforming that data into meaningful, unified business context. That is where Fabric IQ comes in.

Fabric IQ unifies analytical data and operational data, including telemetry, time series, graph, and geospatial data, within a shared semantic framework of business entities, relationships, properties, rules, and actions. Instead of thinking in terms of tables and schemas, your teams and agents can operate on this framework, or ontology, aligned to how the business actually runs.

Fabric IQ ontologies will soon become accessible through an MCP server in preview, enabling agents to discover, understand, and act on this semantic layer. Ontologies can also serve as context sources for maps and soon in operations agents in Fabric, extending shared business context directly into operational decision-making and execution.

We are also excited to announce planning in Fabric IQ, a new enterprise planning capability that enables organizations to create plans, budgets, forecasts, and scenario models directly on top of Fabric’s semantic models. By complementing Fabric IQ’s ontologies with integrated planning, you get a complete, contextual view of your historical, real-time, and forward planning data. This allows users and agents to quickly answer what has happened, what is happening, and what should happen all from a single source. See this in action:

Finally, we recently announced a strategic partnership with NVIDIA to power the next generation of Physical AI by integrating Real-Time Intelligence and Fabric IQ with NVIDIA Omniverse libraries. The combined platform unifies real‑time operational data, business semantics, and physical simulation to enable organizations to optimize their physical operations in scenarios like intelligent digital twins, predictive maintenance, autonomous logistics, and energy optimization.

To learn more about all of our partner announcements, read the Fabric ISV announcement blog and the planning in Fabric IQ blog.

Enhancing the underlying Fabric IQ technology
Powering much of Fabric IQ’s rich experience is a combination of Power BI’s industry-leading, rich semantic model technology and graph in Fabric, our highly scalable graph database. Already delivering insights to more than 35 million active users, semantic models provide the ideal foundation for training agents through Fabric IQ. Now, with the general availability of Direct Lake on OneLake, your tables can be read directly from OneLake with native security enforcement, richer cross-item modeling, and import-class performance without data movement or refresh.

I’m also excited to share that graph in Fabric will be generally available in the coming weeks, enabling teams to visualize and query complex relationships across customers, partners, and supply chains.

To learn more, check out the Fabric IQ announcement blog and the Power BI announcement blog.

Empowering agents to act with Fabric data and operations agents
Frontier organizations are moving beyond general-purpose assistants and instead, adopting multi-agent systems composed of specialized agents. These agents are each grounded on specific data and reusable across different systems, allowing you to deliver more accurate, accelerated, and scalable outcomes.

To support your multi-agent systems, Fabric comes with built-in agent creation capabilities with Fabric data agents and operations agents. I’m excited to share that Fabric data agents are now generally available. Fabric data agents can be thought of as virtual analysts, aligned to specific domain data to support deeper analysis and deliver insights. Operations agents complement them by monitoring real-time data, detecting patterns, and taking proactive action.

Check out a quick demo of operations agents in Fabric:

These agents can be used across Fabric or as foundational knowledge sources in leading AI tools like Microsoft Foundry, Copilot Studio or even Microsoft 365 Copilot. To learn more about our AI announcements, check out the Fabric analytics blog covering data agents and the Fabric IQ blog covering operations agents.

Building mission-critical applications with developer experiences in Fabric
Developers building the next generation of AI applications need a comprehensive, cost-effective data platform that’s already integrated with your existing tools and workflows. Today, we are expanding Fabric’s developer tooling to meet that demand.

First, Fabric Model Context Protocol (MCP) is advancing with two major milestones. Fabric local MCP is now generally available, providing an open-source local server that connects AI coding assistants such as GitHub Copilot directly to Fabric. Alongside this, we’re introducing the public preview of Fabric remote MCP, a secure, cloud‑hosted execution engine that enables AI agents and automation tools to perform authenticated actions in Fabric.

We’re also enhancing our Git integration with selective branching, allowing developers to branch out for a specific feature and pull only the items they need. You also get improved change comparisons to more easily review recent updates, and new folder relationships which show how feature workspaces connect to source workspaces.

We’re also launching two open-source projects to help teams move faster with Fabric: Agent Skills for Fabric and Fabric Jumpstart. Agent Skills for Fabric is an open-source set of purpose-built plugins that let you use natural language in the GitHub Copilot terminal to harness the full power of Microsoft Fabric. Additionally, Fabric Jumpstart is designed to help you get off the ground with detailed guidance, reference architectures, and single‑click deployments for sample datasets, notebooks, pipelines, and reports.

Finally, we are announcing that the Fabric Extensibility Toolkit (FET), an evolution of the Workload Development Kit (WDK), is now generally available. Along with this release, we are enabling support for full CI/CD, variable library, and a new management experience in the Admin portal.

Read the Fabric Platform announcement blog
Migrating your existing Azure service to Fabric
As Fabric continues to grow in functionality, we are also simplifying the migration from other Azure services. In addition to our existing Synapse tooling, we are bringing new migration assistants for Azure Data Factory, Azure Synapse Analytics, and Azure SQL in public preview.

The new Fabric migration assistant for Azure Data Factory and Synapse Analytics helps move your existing pipelines and artifacts like Spark pools and notebooks into Fabric with minimal disruption. It’s designed to support incremental modernization, allowing teams to evaluate, convert, and optimize pipelines as they transition to Fabric. The migration assistant for SQL databases helps move SQL Server into Fabric by importing schemas through DACPACs, identifying and resolving compatibility issues with AI assistance, and guiding teams through assessment and data copy workflows for a smoother cutover.

See more Fabric innovation
Explore the AI shift with The Shift podcast
In addition to the announcements above, we are also rolling out a broad set of Fabric innovations across the platform. For a deeper look at the updates and what’s new this month, visit the Fabric March 2026 Feature summary blog, the Power BI March 2026 feature summary blog, and the latest posts on the Fabric Updates channel.

Explore additional resources for Microsoft Fabric
Sign up for the Fabric free trial. View the updated Fabric Roadmap. Try the Microsoft Fabric SKU Estimator.
Visit the Fabric website. Join the Fabric community. Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog.
Read additional blogs by industry-leading partners
Sonata Software: Building an AI-ready data platform with data agents, ontology, and governance in Microsoft Fabric
Quadrant Technologies LLC: Real-Time Operational Intelligence in Microsoft Fabric: Deep Dive into RTI Capabilities, Anomaly Detection and Activator Alerting
Inspark: Why switch from Azure Synapse to Microsoft Fabric?
Esri: Unlock the power of location intelligence with ArcGIS for Microsoft Fabric
Dream IT Consulting Services: 8 Real-World Use Cases of Data Agents in Microsoft Fabric
UB Technology Innovations Inc.: From Data Platform to Decision Platform: How Microsoft Fabric and Copilot are Redefining Enterprise Analytics
Simpson Associates: Fabric Data Warehouse: Bringing Structure to Modern Data Strategies
Synapx Ltd.: Migrating Power BI to Microsoft Fabric Lakehouse with Medallion Architecture: A Strategic Imperative for Modern Construction Enterprises
Cloud Services: Real-Time Intelligence in Action: How Microsoft Fabric Helped Delfi Transform Its Newsroom
Cloud Services: Microsoft Fabric Data Agents: A New Reality
iLink Digital: Detect to Act in Seconds: How Real-Time Intelligence Is Rewriting the Rules of Emissions Management
Valorem Reply: How Nonprofits Are Rethinking Data with Microsoft Fabric

The post FabCon and SQLCon 2026: Unifying databases and Fabric on a single data platform appeared first on Microsoft Fabric Blog.

That mission is gaining traction at remarkable speed. Since Fabric launched two years ago, it has grown faster than any other data and analytics platform in the industry. More than 28,000 customers—including 80% of the Fortune 500—now rely on Fabric, and its ecosystem continues to expand as partners build solutions to solve the most complex data challenges.

Explore Azure announcements at Microsoft Ignite 2025

Another leap forward across Microsoft Databases and Microsoft Fabric

As Fabric becomes the central connection point for data, we’re strengthening the database layer at the heart of your data estate—ensuring you have the scale and performance required for AI.  

Microsoft already offers one of the industry’s most comprehensive database portfolios, and we’re expanding it even further—while deeply integrating these capabilities into Fabric. I’m excited to announce the general availability of SQL Server 2025, Azure DocumentDB, and SQL database and Cosmos DB in Fabric, along with the preview of our newest addition, Azure HorizonDB. With these new offerings, you have a world-class database option to build once and deploy at the edge, as platform as a service (PaaS), or even as software as a service (SaaS). And because our entire portfolio is either Fabric-connected or Fabric native, Fabric serves as a unified hub for your entire data estate. Below I’ll cover how these new databases are purpose-built to support your AI projects.  

Deploy the next generation of Microsoft Databases

Modernize your SQL estate with SQL Server 2025, now generally available

Microsoft has been shaping the SQL landscape for more than 35 years. Now, with the release of SQL Server 2025 into general availability, we’re introducing the next evolution—one that brings developer‑first AI capabilities at the edge, within the familiar T‑SQL experience. Smarter search combines advanced semantic intelligence with full‑text filtering to uncover richer insights from complex data. AI model management using model definitions in T-SQL allows seamless integration with popular AI services such as Microsoft Foundry.

Enterprise reliability and security remain best-in-class. Enhanced query performance, optimized locking, and improved failover help ensure higher concurrency and uptime for mission‑critical workloads. With strengthened credential management through Microsoft Entra ID via Azure Arc, SQL Server 2025 is secure by design. Your data is also instantly accessible for your AI and analytics in Microsoft OneLake with mirroring for SQL Server 2025 in Fabric, now also generally available.

SQL Server 2025 is the most significant release for SQL developers in a decade. And the response to our preview has been overwhelming, with 10,000 organizations participating, 100,000 databases already deployed, and download rate two times higher than SQL Server 2022. If you want to join all those who’ve already adopted SQL Server 2025, download it today.

Azure DocumentDB: MongoDB-compatible, AI-ready, and built for hybrid and multi-cloud

We’re excited to announce Azure DocumentDB, a new service built on the open-source, MongoDB-compatible DocumentDB standard governed by the Linux Foundation. The first Azure managed service to support multi-cloud and hybrid NoSQL, Azure DocumentDB can run consistently across Azure, on-premises, and other clouds.

Azure DocumentDB gives you the freedom to embrace open source while achieving scale, security, and simplicity. It’s AI-ready, with capabilities like vector and hybrid search to deliver more relevant results. Instant autoscale meets demand, and independent compute and storage scaling keeps workloads efficient. Security and availability is standard, with Microsoft Entra ID integration, customer-managed encryption keys, 35-day backups included, and a 99.995% availability service-level agreement (SLA). And soon, enhanced full-text search will add features like fuzzy matching, proximity queries, and expanded language support, making it even easier to build intelligent, search-driven apps.

Azure DocumentDB is now generally available, so you can try it today. You can also learn more about Azure DocumentDB and all the Azure Database news by reading Shireesh Thota’s, Corporate Vice President of Azure Databases, announcement blog.

Azure HorizonDB: PostgreSQL designed for your mission-critical workloads

PostgreSQL has become the backbone of modern data solutions thanks to its rich ecosystem, extensibility, and open source foundation. Microsoft is proud to be the #1 PostgreSQL committer among hyperscalers, and we’re building on that leadership with Azure HorizonDB.

Now in early preview, Azure HorizonDB is a fully managed, PostgreSQL-compatible database service, built to handle the scale and performance required by the modern enterprise. It goes far beyond open source Postgres, with auto-scaling storage up to 128 TB, scale-out compute up to 3,072 vCores, <1 millisecond multi-zone commit latency, and enterprise security and compliance. Vector search is built-in, along with integrated AI model management and seamless connectivity to Microsoft Foundry so you can build modern AI apps. Combined with GitHub Copilot, Fabric, and Visual Studio Code integrations, it provides an intelligent and secure foundation for building and modernizing applications at any scale. To learn more about Azure HorizonDB, read our announcement blog.

Paused

Accelerate app development with Fabric SaaS Databases, now generally available

We are also releasing a new class of SaaS databases, both SQL database and Cosmos DB in Fabric, into general availability. Data developers now have access to world-class database engines within the same unified platform that powers analytics, AI, and business intelligence.

Fabric Databases are designed to streamline your application development. You can provision them in seconds, and they don’t require the usual granular configuration or deep database expertise. They provide enterprise-grade performance, are secure by default with features like cloud authentication, customer-managed keys, and database encryption, and come natively integrated into the Fabric platform, even using the same Fabric capacity units for billing.

With Fabric databases, developers now have the flexibility to build applications grounded in operational, transactional, and analytical data. Together, these offerings make Fabric a developer-first data platform that is streamlined, scalable, and ready for modern data applications.

Paused

Learn more by reading Shireesh Thota’s, Corporate Vice President of Azure Databases, announcement blog.

All your databases connected into Fabric

We’re making it easier than ever to work with your entire Microsoft database portfolio in Fabric, giving you a single, unified place to manage and use all your data. Building on our existing mirroring support for Azure SQL Database and Azure SQL MI, we’re now announcing the general availability of mirroring for Azure Database for PostgreSQL, Azure Cosmos DB, and SQL Server versions 2016–2022 and 2025. With these databases mirrored directly into Fabric, you can eliminate traditional extract, transform, and load (ETL) pipelines and make your data instantly ready for analytics and AI.

Getting your data estate ready for AI with Microsoft Fabric

Choosing the right database is essential, but it’s just the beginning. The major opportunity lies in driving frontier transformation, where data becomes the foundation for an AI-native enterprise. We recommend focusing on three core steps:

• Unifying your data estate to eliminate silos and complexity.
• Creating semantic meaning so your data is ready for AI.
• Empowering agents to act on insights and transform operations.

In this section, I’ll dive into the latest enhancements to Microsoft Fabric that help you achieve every step of your data journey. This includes expanded interoperability in OneLake with SAP, Salesforce, Azure Databricks, and Snowflake, the introduction of Fabric IQ—a new workload that adds semantic understanding—and enhanced agentic capabilities across Fabric to help you build richer, AI-powered data experiences.

This is the future of data, and it’s already within reach. With Fabric and our database innovations, Microsoft is helping organizations move seamlessly from insight to action—unlocking the full potential of your data and the AI built on top of it.

Unify your data estate with Microsoft OneLake

Microsoft OneLake unifies all your data—across clouds, on-premises, and beyond Microsoft—into a single data lake with zero-ETL capabilities like shortcuts and mirroring. Alongside the additional mirroring sources for Microsoft Databases, we’re also introducing the preview of shortcuts to SharePoint and OneDrive. This allows you to bring unstructured productivity data into OneLake without copying files or building ETL pipelines, making it easier to train agents and enrich your structured data.

See how shortcuts and mirroring unify your data in OneLake:

Paused

Once connected to OneLake, your data becomes easily discoverable in the apps your teams use every day like Power BI, Teams, Excel, Copilot Studio, and Microsoft Foundry. Today, we are taking that a step further with native integration with Foundry IQ—the next generation of retrieval-augmented generation (RAG). Agents rely on context—Foundry IQ’s knowledge bases deliver high-value context to agents by simplifying access to multiple data sources and making connections across information. You can use the OneLake knowledge source in Foundry IQ to connect agents to multi-cloud sources like AWS S3, on-premises sources, and structured and unstructured data.

Expanding OneLake interoperability with leading data platforms

We are also seeing great momentum with dozens of partners outside of Microsoft deeply integrating with OneLake, including ClickHouse, Dremio, Confluent, EON, and many more. And now, we are thrilled to add new, deeper interoperability with SAP, Salesforce, Azure Databricks, and Snowflake.

First, we’re deepening interoperability with the systems organizations rely on most, SAP and Salesforce. With the launch of SAP Business Data Cloud Connect for Microsoft Fabric, customers can allow bidirectional, zero-copy data sharing between SAP Business Data Cloud (BDC) and Fabric. At the same time, we are working with Salesforce to integrate their data into Fabric using the same zero-copy approach, unlocking advanced analytics and AI capabilities without the overhead of traditional ETL.

We’re also strengthening interoperability with Azure Databricks and Snowflake so you can use a single copy of data across platforms. By the end of 2025, Azure Databricks will release, in preview, the ability to natively read data from OneLake through Unity Catalog, enabling seamless access without duplication or complex data movement. Looking ahead, Databricks will also add support for writing to and storing data directly in OneLake, allowing full two-way interoperability. Read more about this interoperability.

Our collaboration with Snowflake on bidirectional data access continues as well. We are introducing a new item in OneLake called a Snowflake Database and a new UI in Snowflake—both designed to allow OneLake to be the native storage solution for your Snowflake data. We’re also bringing Snowflake mirroring to general availability, allowing you to virtualize your external Snowflake-managed Iceberg tables in OneLake with shortcuts created and handled automatically. Together, these innovations let you run any Fabric workload—whether analytics, AI, or visualization—directly on your Snowflake-managed Iceberg tables.

Learn more about our Snowflake collaboration by reading our latest joint blog or by watching the following demo:

Paused

Finally, in close collaboration with dbt Labs, we are also excited to announce built-in support for their industry leading data transformation capability. Now in preview, dbt jobs in Microsoft Fabric let you build, test, and orchestrate dbt workflows in your Fabric workspaces. Learn more in this blog.

Create semantic knowledge to fuel AI with Fabric IQ

As Frontier Firms train agents on their enterprise data, it’s become clear that quality and context matter more than data volume. Agents need business context across relationships, hierarchies, and meaning to turn raw data into actionable insight. That’s why we’re introducing Fabric IQ—a new workload designed to map your datasets to the real-world entities they represent, creating a shared semantic structure on top of your data.

The power of IQ lies in how it unifies disparate data types under a single, coherent framework. Built upon Power BI’s industry-leading, rich semantic model technology, IQ brings together analytical data, time-series telemetry, and geospatial information, all organized under a semantic framework of business entities and their relationships, properties, rules, and actions. You can then create operations agents, a new type of agent in Fabric, which can use this model to act as virtual team members, monitoring real-time data sources, identifying patterns, and taking proactive action. Instead of forcing your teams and even agents to think in terms of tables and schemas, IQ allows you to align data with how your organization operates.

Watch the Introducing IQ in Microsoft Fabric video

In short, Fabric IQ is designed to model reality with data, so that every insight, prediction, and action is grounded in how your organization actually operates. You can learn more about IQ in Yitzhak Kesselman’s, Corporate Vice President of Messaging and Real-Time Intelligence, announcement blog.

Empower data-rich agents with Copilot, Fabric data agents, and operations agents

As organizations scale their AI initiatives, the ability to connect intelligent agents with enterprise-grade data is becoming a critical differentiator. Fabric is making this possible with a set of integrated AI experiences: Copilot in Power BI helps you ask questions of your data, Fabric data agents allow deeper analysis, and the new Fabric operations agents let you monitor your data estate and take action in real time. These experiences can be used across Fabric or as foundational knowledge sources in industry-leading AI tools like Microsoft Foundry, Copilot Studio or even Microsoft 365 Copilot to power smarter, more data-rich AI experiences.

Beyond introducing operations agents as part of Fabric IQ, we’re also expanding what data agents and Copilot can do. Along with existing integration with Microsoft Foundry and Copilot Studio, Fabric data agents can now be embedded directly in Microsoft 365 Copilot. This lets business users (with the right permissions) access trusted knowledge from OneLake and transforms Microsoft 365 from a productivity suite into an intelligent insights platform.

Paused

They can also act as hosted Model Context Protocol (MCP) servers, making it easy to integrate with other applications and agents across the AI ecosystem. Finally, data agents can now reason across both structured and unstructured data. Thanks to an integration with Azure AI Search, data teams can add their existing unstructured data search endpoints as a source in data agents. Learn more the Fabric data agent enhancements by reading the Fabric AI blog.

We’re also enhancing the standalone experience for Copilot in Power BI with a new search experience. Simply describe what you need, and Copilot will locate the relevant report, semantic model, or data agent and surface the right answers. This standalone experience is also coming to Power BI mobile so you can use it on the go.

Take a look at how you can apply all of these AI experiences together seamlessly:

Paused

In short, we’re redefining what it means to have an AI-powered data estate. With data agents, Copilot in Power BI, and operations agents in Fabric IQ, AI is now woven across Fabric. And with native integration to Microsoft Foundry and Copilot Studio, you can easily add Fabric agents as building blocks to create more intelligent, informed custom agents.

You also can see more innovation coming to the Fabric platform by reading Kim Manis’, Corporate Vice President of the Fabric Platform, Fabric blog or by checking out the more technical Fabric November 2025 Feature summary blog.

Mark your calendar for FabCon and SQLCon

We are excited to announce SQLCon 2026, which will happen at the same time and the same location as the Microsoft Fabric Community Conference (FabCon), happening March 16–20, 2026 in Atlanta, Georgia. By uniting the powerhouse SQL and Fabric communities, we’re giving data professionals everywhere a unique opportunity to master the latest innovations, share practical knowledge, and accelerate what’s possible with data and AI, all in one powerful week. Register for either conference and enjoy full access to both, with the flexibility to mix and match sessions, keynotes, and community events to fit your interests.

Register for FabCon and SQLCon now

Watch these announcements in action at Microsoft Ignite

If you’re interested in seeing these announcements live, I encourage you to join my Ignite session, “Innovation Session: Microsoft Fabric and Azure Databases – the data estate for AI” either in person or online at no cost. I’ll not only cover these major announcements but show you how they come together to help you create a unified, intelligent data foundation for AI.

You can also dive deeper into these announcements and so much more by watching the rest of the breakout sessions across Azure Data:

Tuesday, November 18

• Modern data, modern apps: Innovation with Microsoft Databases
• Microsoft Fabric: The data platform for the next AI frontier
• Unifying your data journey: Migrating to Microsoft Fabric

Wednesday, November 19

• Premier League’s data-driven fan engagement at scale
• Create a semantic foundation for your AI agents in Microsoft Fabric
• Move fast, save more with MongoDB-compatible workloads on DocumentDB
• SQL database in Fabric: The unified database for AI apps and analytics
• The blueprint for intelligent AI agents backed by PostgreSQL
• Connect to and manage any data, anywhere in Microsoft OneLake
• Unlock the power of Real-Time Intelligence in the era of AI
• Empower Business Users with AI driven insights in Microsoft Fabric

Thursday, November 20

• Real-time analytics and AI apps with Cosmos DB in Fabric
• From interoperability to agents: Powering financial workflows with AI
• How Fabric Data Agents Are Powering the Next Wave of AI

Explore Azure announcements at Microsoft Ignite 2025

The post Microsoft Databases and Microsoft Fabric: Your unified and AI-powered data estate appeared first on Microsoft Fabric Blog.

For nearly a decade, Microsoft and Databricks have closely partnered with the goal of empowering organizations to unlock the value of their data. Together, we’ve delivered solutions that combine the flexibility of the lakehouse architecture with the scale and security of Azure. Today, we’re taking that collaboration even further by deepening integration between Azure Databricks and Microsoft OneLake.

Delivering on the promise of an open data lakehouse

The current pace of technological innovation requires data estates to be more flexible than ever before. Seamless interoperability between platforms is no longer an ideal goal but a technical imperative. Organizations need the freedom to choose the right tools for their data project without worrying about data silos or complex integrations. That’s why Databricks pioneered the open lakehouse architecture, and why Microsoft built OneLake—an open data lake designed to serve as the foundation for data and AI.

Together, we’re making this vision real:

• Mirroring data into OneLake – already generally available
  Earlier this year we released Azure Databricks mirroring. Customers can already mirror Databricks data into OneLake through Unity Catalog. ensuring that all data—including the highest performance tables managed by Azure Databricks—are instantly available across Microsoft Fabric workloads. Both platforms can work over the same copy of data stored in Delta Lake format with no data movement.
• Reading data from OneLake – coming by year-end
  While Databricks managed data is available in OneLake, reading OneLake data from Databricks will soon be enabled with the recent OneLake catalog API. By the end of 2025, Azure Databricks will enable native reading from OneLake through Unity Catalog in preview, allowing users to seamlessly access data stored in OneLake without duplication or complex pipelines. Data can come from any Fabric workload. This means faster analytics and lower costs.

Writing and storing data natively in OneLake – on the horizon

Looking ahead, Azure Databricks will support writing and storing data directly in OneLake, without any additional storage resources to manage. This will deliver additional simplicity and interoperability for customers building on the lakehouse architecture. We’ll share timelines for this capability at FabCon in March 2026.

Why this matters for customers

These new integrations go beyond technical progress—they underscore our shared commitment to openness, flexibility, and empowering customers with choice. Together, Microsoft and Databricks are helping organizations unlock more value from their data with a seamless, unified foundation across both platforms.

With these integrations, customers can:

• Choose the right engine and tool for the job at hand: Gain full flexibility to pick the engine, tool, or platform you want for every task—based on your goals, workloads, or team expertise—without compromise.
• Bring data directly into your productivity apps: The OneLake catalog is now woven into Microsoft 365 experiences such as Teams, Excel, and Copilot Studio. This means business users can easily discover, access, and apply insights right where they work. For example, Teams users can enrich chats, channels, and meetings with data-driven context, with any data governed by OneLake or Unity Catalog.
• Scale resources efficiently and focus on innovation: With a single, shared copy of data across Microsoft Fabric and Azure Databricks, you can eliminate costly duplication, streamline governance, and redirect time and investment toward innovation instead of data movement.
• Deliver richer AI and analytics outcomes: Whether you’re building copilots in Microsoft Copilot Studio and AI Foundry, building Agents in Azure Databricks, or visualizing data in Power BI, you can unify and integrate data across Azure Databricks and Microsoft solutions—without ever moving it. Likewise, data in OneLake can seamlessly flow into Azure Databricks to power advanced AI, analytics, and data-sharing scenarios.

A shared commitment to innovation

Our collaboration is built on trust and a shared belief that openness drives innovation. By bringing Azure Databricks and OneLake closer together, we’re giving customers the freedom to build modern data architectures without compromise.

We’re excited about what’s next—and we’re just getting started.

The post Microsoft and Databricks: Advancing Openness and Interoperability with OneLake appeared first on Microsoft Fabric Blog.

Welcome everyone to the second annual European Microsoft Fabric Community Conference this week in the vibrant city of Vienna, Austria! With more than 130 sessions and 10 full-day workshops, this year’s sold-out European event is bigger than ever and there’s no shortage of incredible learning experiences. More than 4,200 attendees will get to test their driving skills on a high-octane racing simulator powered by Fabric Real Time Intelligence, ask their questions directly at expert-staffed booths, compete for a chance to be crowned the DataViz World Champion, and celebrate Microsoft Power BI’s tenth anniversary.

This event is an opportunity to get much deeper into Microsoft Fabric, which has now become the fastest growing data platform in Microsoft’s history.¹ In less than two years, we’ve been able to expand Microsoft Fabric into a complete data and analytics platform with more than 25,000 customers, including about 80% of the Fortune 500, spanning everything from analytics to databases to real-time insights.

Microsoft has massive investments in Fabric, and I’m thrilled to share a new slate of announcements that will further advance Fabric’s vision as the most comprehensive, enterprise-grade data platform on the planet. These announcements include new OneLake shortcut and mirroring sources, a brand-new Graph database enabling you to connect entities across OneLake, new geospatial capabilities with Maps in Fabric, improved developer experiences, and new security controls—giving you what you need to run your mission-critical scenarios on Fabric.

Unify your data with OneLake, the AI-ready data foundation

Any successful AI or data project starts with the right data foundation. Organizations like Lumen, IFS, NTT Data, and the Chalhoub Group have all adopted Microsoft OneLake as the unified access point for their data. Lumen—a leader in enterprise connectivity—cut 10,000 hours of manual effort with OneLake. “We used to spend up to six hours a day copying data into SQL servers,” says Chad Hollingsworth, Cloud Architect at Lumen. “Now it’s all streamlined. OneLake allowed us to ingest once and use anywhere.”

With mirroring and OneLake shortcuts, we’ve simplified how you connect to and transform your data with a zero-copy, zero-ETL approach that allows you to instantly connect to any data—no matter the cloud, database, vendor, engine, or format. In addition to the recent announcement of mirroring for Azure Databricks, we are thrilled to announce the preview of mirroring for Oracle and Google BigQuery, allowing you to access your Oracle and Google data in OneLake in near real-time. We are also extending Fabric data agents to support all mirrored databases, so you can ask questions about your external database data. Additionally, we are announcing the general availability of OneLake shortcuts to Azure Blob Storage and the preview of new OneLake shortcut transformations to automatically convert JSON and Parquet files to Delta tables, for instant analysis. Finally, we are releasing the OneLake integration with Azure AI Search into general availability, enabling you to easily ground your custom agents with OneLake data.

With your data in OneLake, the OneLake catalog then provides the tools to discover, govern, and secure your data from a single place. With more than 30 million monthly active Power BI and Fabric users, it’s already the default source of data and insights. We are also launching OneLake security into full preview and creating a new tab in the OneLake catalog called Secure, where you can manage the security and permissions for all your data items. Along with this new tab, we are releasing OneLake catalog Govern tab into general availability.

We are also excited to enrich our extensibility story with the preview of a new OneLake Table API, which lets apps use GET and LIST calls to discover and inspect OneLake tables stored in either Iceberg or Delta format using Fabric’s security model. Finally, for workspace owners, we are releasing preview of OneLake diagnostics that allows you to capture all the data activity and storage operations for a specific workspace into any lakehouse in the same capacity.

Train smarter agents with connected intelligence from graph and maps in Fabric

The first step in starting any agentic project is data. You need to bring the data together and ensure your data estate can handle the volume of data used in training. But sophisticated AI agents require more than simply huge quantities of data. To provide you with accurate answers grounded on your business, they need to first understand the relationships between data. They need to understand your business operations. They need context.

We believe this is the next major shift now required for a modern AI-ready data estate. You can learn more about this shift and our vision in Jessica Hawk’s blog, “Microsoft leads shift beyond data unification to organization, delivering next gen AI readiness.” To help you provide this context to your agents or any other data project, we are excited to announce the preview of two transformative new features in Fabric: Graph and Maps.

Model, analyze, and visualize complex data relationships

Graph in Fabric is designed to enable organizations to visualize and query relationships that drive business outcomes. Built upon the proven architecture principles of LinkedIn’s graph technology, graph in Fabric can help you reveal connections across customers, partners, and supply chains. But like your data, graph in Fabric is easier to explain visually.

Graph in Microsoft Fabric is a game changer. The highly scalable graph engine coupled with Fabric’s ease of use is a uniquely powerful combination.

—Luke Hiester, Senior Data Scientist, Eastman Chemical Company

Graph will roll out in various Fabric regions starting on October 1, 2025.

Visualize, analyze, and act on location-based data instantly

Maps in Fabric can help you bring geospatial context to your agents and operations by transforming enormous volumes of location-based data into interactive, real-time visualizations that drive location-aware decisions and enhance business awareness. Check out a full demo of the new Maps in Fabric experience.

By combining streaming analytics, geospatial mapping, and contextual modeling, maps can help you extract location-based insights for your existing business processes to drive better awareness and outcomes.

You can learn more about graph and maps in Yitzhak Kesselman’s “The Foundation for Powering AI-Driven Operations: Fabric Real-Time Intelligence” blog.

Delighting developers with new tools in Fabric

Power BI is a leader in business intelligence for developers with more than 7 million actively building data visuals. Now, Microsoft Fabric is quickly becoming the home for all data developers. To help developers feel even more at home, we’re adding a huge range of new tooling across Fabric.

First, we’ve released the Fabric Extensibility Toolkit into preview—an evolution of the Microsoft Fabric Workload Development Kit but newly designed to help any developer bring their data apps to Fabric for their own organizations along with a simplified architecture and additional automation to drastically streamline development. Developers can now simply build their own Fabric items, and everything else like distribution, user interface, and security is taken care of for you—try it today.

We’re also introducing the preview of Fabric MCP, a developer-focused Model Context Protocol that enables AI-assisted code generation and item authoring in Microsoft Fabric. Designed for agent-powered development and automation, it streamlines how you build using Fabric’s public APIs with built-in templates and best-practice instructions. It also integrates with tools like Microsoft Visual Studio Code and GitHub Codespaces and is fully open and extensible.

With the general availability of Git integration and deployment pipelines with lakehouses, data warehouses, copy jobs, activator, Power BI reports, and many more, we are excited to announce that you can employ continuous integration and continuous delivery (CI/CD) capabilities across the Fabric platform. We are even extending CI/CD support to Fabric data agents. We are also releasing User Data Functions and the Fabric VS Code extension into general availability. And we are releasing an open-source version of the command line interface in Fabric.

Finally, we are also releasing horizontal tabs for open items, support for multiple active workspaces, and a new object explorer—all designed to make multitasking in Fabric smoother, faster, and more intuitive.

Build your mission-critical scenarios on Microsoft Fabric

Fabric has comprehensive, built-in tools for network security, data security, and governance, enabling any organization to effectively manage and govern their data. A detailed overview of all of the existing capabilities are available in the Fabric Security Whitepaper.

Now, we are thrilled to announce significant additions to our security, capacity management, performance, and migration—all of which further cement Fabric as the ideal data platform for every AI and mission-critical scenario. Frontier firms implementing AI need more than just next-generation AI tools. You need a comprehensive, cost-effective data platform to support your projects with end-to-end data protection, integration with developer tools, and performance that can scale to any need. Microsoft Fabric has both the leading generative AI capabilities and the enterprise-ready foundation to truly foster an AI-powered data culture.

Connect securely to even the most sensitive data

First, we are providing additional safeguards to help you manage secure data connections and precisely manage the level of isolation you need in each workspace. We are excited to announce the general availability of Azure Private Link in Fabric and outbound access protection for Spark, and the soon to be released preview of workspace IP filtering—all at the workspace-level. Additionally, we are expanding mirroring to support on-premises data sources and data sources behind firewalls. Finally, we are excited to announce the general availability of customer managed keys for Fabric workspaces coming next month.

More granular capacity management

Gaining control over the jobs running on your Fabric capacities is critical to any mission critical scenario. To give you this control, we are announcing the general availability of surge protection for background jobs and the preview of surge protection for workspaces. With surge protection, you can set limits on background activity consumption and now, specific workspace activity—helping you protect capacities from unexpected surges.

Enhanced Fabric Data Warehouse performance

Fabric is engineered to handle massive data volumes with exceptional performance across its analytics engines, and we’re continuously enhancing their efficiency. Since August 2024, we’ve released 40 performance improvements to Fabric Data Warehouse driven by your feedback, resulting in a 36% performance improvement in industry standard benchmarks—try Fabric Data Warehouse today.

Seamlessly migrate your Synapse data to Fabric

We are also excited to release the general availability of an end-to-end migration experience natively built into Fabric, enabling Azure Synapse Analytics (data warehouse) customers to transition seamlessly to Microsoft Fabric. The migration experience allows you to migrate both metadata and data from Synapse Analytics and comes with an intelligent assessment, guided support, and AI-powered assistance to minimize the migration effort.

Extend Fabric with partner-created workloads and seamless integration with Snowflake

We are excited to announce the general availability of new partner solutions native to Microsoft Fabric from ESRI, Lumel, and Neo4j. ESRI’s advanced geospatial analytics, Lumel’s vibrant business intelligence insights, and Neo4j’s graph analytics are all just a click away in the Fabric workload hub. In addition, several new partners are announcing capabilities built on Microsoft Fabric, learn more by reading the FabCon Vienna partner blog.

In May of 2024, we announced an expanded partnership with Snowflake—committing both our platforms to provide seamless bi-directional integration and enable customers with the flexibility to do what makes sense for their business. Since then, we’ve expanded interoperability between Snowflake and Microsoft OneLake including the ability to write Snowflake tables to OneLake, the ability to use OneLake shortcuts to access Snowflake tables, the ability to read OneLake tables directly from Snowflake, and full support for Apache Iceberg format in OneLake. Now, we are releasing new Iceberg REST Catalog APIs that allow Snowflake to read Iceberg tables from OneLake, keeping OneLake tables automatically in sync. You can learn more about this new announcement and our partnership by reading the Microsoft OneLake and Snowflake interoperability blog.

See more Microsoft Fabric innovation

In addition to the announcements above, we are excited to share a huge slate of other innovations coming to Fabric, including enhancements to SQL databases in Fabric, the preview of Runtime 2.0, the preview of AI functions in Data Wrangler, the general availability of editing semantic models in the Power BI service, and so much more.

You can learn more about these announcements and everything else by reading the Fabric September 2025 Feature summary blog, the Power BI September feature summary blog, or by exploring the latest blogs on the Fabric Updates channel.

Join us at FabCon Atlanta and Microsoft Ignite

Already excited about the next FabCon? Join us in Atlanta, Georgia, from March 16 to 20, 2026, for even more in-depth sessions, cutting-edge demos and announcements, community networking, and everything else you love about FabCon. Register for FabCon today and use code MSCATL for a $200 discount on top of current Early Access pricing!

In the meantime, you can join us at Microsoft Ignite this year from November 18 to 21, 2025, either in person in San Francisco or online to see even more innovation coming to Fabric and the rest of Microsoft. You’ll see firsthand the latest solutions and capabilities across all of Microsoft and connect with experts who can help you bolster your knowledge, build connections, and explore emerging technologies.

Explore additional resources for Microsoft Fabric

• Sign up for the Fabric free trial.
• View the updated Fabric Roadmap.
• Try the Microsoft Fabric SKU Estimator.
• Visit the Fabric website.
• Join the Fabric community.
• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog.

Sign up now for our upcoming ask the Fabric expert sessions

• Join us on September 24, 2025, for the “Ask the Experts—Microsoft OneLake” webinar where experts from our OneLake team will join to answer all your questions live.

Get certified in Microsoft Fabric

• Join the thousands of other Fabric users who’ve achieved more than 50,000 certifications collectively for the Fabric Analytics Engineers and Fabric Data Engineers roles. To celebrate FabCon Vienna, we are offering the entire Fabric community a 50% discount on exams DP-600, DP-700, DP-900, and PL-300. Request your voucher.

Join the FabCon Global Hackathon

• Build real-world data and AI solutions that push the boundaries of what’s possible with Microsoft Fabric. Join the hackathon to compete for prizes up to $10,000.

Read additional blogs by industry-leading partners

• How AI-native data platforms are redefining business by PricewaterhouseCoopers LLP.
• Your Operational Data Just Became Your Smartest Business Agent by iLink Digital.
• From OLTP to AI: Choosing Your Microsoft Fabric Database Engine by Lumel Technologies.
• Building scalable e-commerce product recommendations with Microsoft Fabric SQL by MAQ Software.
• Things You Should Know About MCP in Microsoft Fabric by Nimble Learn.
• How to Estimate Microsoft Fabric Costs: Capacity Planning Strategies for AI Workloads by JourneyTeam.
• How Microsoft Fabric Modernized & Transformed ERP Data Analytics by Bizmetric.
• Unlocking the full value of Data as a Product with Microsoft Fabric and Purview by Thoughtworks.

¹Microsoft FY25 Q4 earnings report

The post FabCon Vienna: Build data-rich agents on an enterprise-ready foundation appeared first on Microsoft Fabric Blog.

This blog post is co-authored by Christian Kleinerman, Executive VP of Product, Snowflake.

The typical organization’s data estate now includes hundreds of specialized and often disconnected applications—all of which generate data that you need to understand. To capture and analyze this data, each department and team has their own data and AI service that meets their specific needs, whether that be ease-of-use, familiarity, or specialized functionality. Interoperability between not only the applications, but the data platforms themselves, is no longer a technical aspiration but a necessity for most businesses.

Microsoft and Snowflake announced a shared vision one year ago with this in mind: simplify interoperability, reduce data movement, and accelerate insights by enabling seamless data access between Snowflake and Microsoft OneLake—our single, unified SaaS data lake—to enable mutual customers to more easily access all their data. This vision is anchored in open standards like Apache Iceberg and Parquet, allowing customers to use one copy of data across platforms and choose the right tool for the job at hand. This approach can help our customers do what makes the most sense for their business without creating data silos or duplicating data.

Today, we’re excited to share the progress we’ve made to expand interoperability including what’s available now, what’s in preview, and what’s coming next.

How interoperability works

Snowflake and Microsoft OneLake interoperate through open standards. Snowflake supports Apache Iceberg tables stored in OneLake, so you can create and manage Iceberg tables in OneLake and access them from both Snowflake and Fabric engines without moving or duplicating data. It also means you only need to load the data into the lake once, and all the engines can operate on the same copy of data. This single copy approach means teams can collaborate on a single source of truth rather than fragmenting information across data platforms.

OneLake uses open formats (Parquet, Delta, Iceberg) and exposes standard endpoints, which means your existing tools and SDKs work without custom connectors. This ensures that data remains in OneLake while being accessible by multiple engines, giving you one copy of data for analytics, AI, and BI. While most Fabric engines store their data using the delta lake format and Snowflake uses Iceberg, this is not a problem. Microsoft OneLake seamlessly provides both metadata formats automatically so that all data can work in any platform.

What’s available (GA and preview)

OneLake supports Iceberg, and Snowflake supports OneLake. With many items now going into general availability, you can access this bi-directional data support, enabling seamless interoperability without data duplication.

We are excited to announce the following features are moving into either preview or general availability in the next few weeks:

• General availability: Automatic translation of Iceberg metadata to Delta Lake metadata for use with all Fabric engines.
• General availability: Shortcut Snowflake Iceberg data stored in Azure, Amazon S3, or GCS into your existing OneLake.
• Preview: Automatic translation of Fabric data to Iceberg format for easy use within Snowflake.
• Preview: New OneLake table APIs which seamlessly integrate with Snowflake’s catalog-linked database feature.

And finally, you can store Snowflake Iceberg data natively in OneLake, already available in preview.

Coming soon

• Deeper experience integrations designed to make setup and collaboration between the Fabric and Snowflake services even easier.

One copy across platforms—why this matters

The ability to use a single copy of your data across both Snowflake and Fabric enables several compelling use cases:

• Build an open lakehouse on your terms: Pick the right engine and tool across either platform depending on the task at hand, your skillset, or your needs.
• Turn Microsoft 365 into hubs for discovering and applying insights: With the OneLake catalog embedded in hundreds of the most widely used apps like Microsoft Teams, Microsoft Excel, and Microsoft Copilot Studio, you can help all your business users discover and use data. For example, your Teams users can infuse data into their everyday work with embedded channels, chat, and meeting experiences. And security defined in OneLake travels with the data so you can ensure business users only access what they should.
• More efficiently scale team resources and shift from data movement to drive innovation: With a single copy of data across Snowflake and Fabric, you can spend less time organizing and governing your data estate, reduce the costs of duplicating data across various locations, and dedicate more time to discovering insights.
• Deliver high fidelity AI and analytics data products by unifying your data: Whether you’re building an agent in Microsoft Copilot Studio or curating a Power BI dashboard, you can integrate your data in Snowflake with your Microsoft solutions to enrich your results without any data movement. Likewise, data stored in OneLake can be extended to Snowflake to build AI apps or more easily share data, among many other workloads.
• Build a single, connected and governed view of your open lakehouse: Integrate OneLake via Iceberg REST APIs to Snowflake using Catalog Linked Databases to securely centralize and access all your Iceberg tables from a single governed pane of glass.

Get started building with Snowflake and Fabric

• Request an exploration call or join the latest private preview of Iceberg Table Virtualization by signing up.
• Try the Snowflake Quickstart for Iceberg in OneLake.
• Read the original partnership blog for architecture details.
• Explore our OneLake developer guidance for endpoints and SDKs.
• Learn how to build data-rich agents at FabCon Vienna 2025.

The post Microsoft and Snowflake: Delivering on the promise of openness and interoperability appeared first on Microsoft Fabric Blog.

The post Powering the next AI frontier with Microsoft Fabric and the Azure data portfolio  appeared first on Microsoft Fabric Blog.

Microsoft Fabric is a unified data platform that continues to transform businesses worldwide, with more than 19,000 organizations and 74% of Fortune 500 companies leveraging Fabric. At FabCon, customers from around the world will share how they are pushing the boundaries of data at scale and unlocking new possibilities for business innovation. 

The London Stock Exchange (LSEG), for example, is leveraging Fabric to unify their data estates and efficiently process their data:

“Microsoft Fabric has been pivotal in LSEG’s data platform modernization journey. With Fabric Spark as the core engine powering our customer facing enterprise data platform, LSEG manages large volumes of time critical financial markets data that require complex data quality and transformation rules, executed at scale and with consistent service levels. Combining this with the broader Fabric eco-system has opened up new and exciting customer experiences and AI-powered opportunities.” 

 —Phil Withey, Head of Architecture, LSEG Microsoft Partners

Similarly, International Workplace Group (IWG) is revolutionizing its approach to data integration: 

“Microsoft Fabric was a game changer because of its ability to create shortcuts without physically moving data from one place to another. Before, if I had to incorporate three sources, I had to create pipelines to bring in the data. That pipeline had a cost. The data movement had a cost. With Fabric, it’s two clicks and that’s it.” 

—José Viegas, Senior Data Architect, IWG 

We’re always listening and learning to further enable customer successes like these by delivering the latest innovations across the data estate. See how customers around the world are using Fabric to transform their teams and industries.

New capabilities coming to Microsoft Fabric 

Today, we’re enhancing the Fabric experience by unlocking new possibilities through key innovations designed to help strengthen security and harness the power of AI to streamline data workstreams like never before:

Introducing OneLake security—an industry breakthrough in data protection 

Managing granular data security across multiple applications and engines is complex, often resulting in excessive restrictions or accidental data exposures. That’s why we’re introducing OneLake security—an industry breakthrough in data protection. OneLake is Fabric’s unified data lake, which seamlessly connects your entire multi-cloud and on-premises data estate. All your teams get a single place to discover, explore, and manage their data—even within apps like Microsoft Teams and Excel. 

Now with OneLake security, you can define access permissions once, and Fabric will enforce it consistently across all engines. Data owners can create security roles, refine permissions, and control access at the row and column levels to securely share data. For example, you can grant access to only certain folders, tables, or even rows in a lakehouse—restricting Personally Identifiable Information (PII) while keeping other data available. This security propagates automatically, so whether you query the data in SQL or visualize it in a Power BI report, you can only see what has been authorized. Check out the following demo to see OneLake security in action.

We are thrilled to share that OneLake security will be available in preview within a few months. In the meantime, if you are interested in trying OneLake security on your workspaces and providing feedback, please visit this early access OneLake security sign-up page.

• Read more in the OneLake security blog. 

Empowering agentic AI by integrating Fabric data agents with Azure AI Foundry

Data plays a critical role in agentic AI, enabling AI agents to operate independently, make informed decisions, and take meaningful actions. That’s why we are expanding capabilities and deepening integrations between our data and AI platforms. 

Data agents (formerly known as AI skills) in Microsoft Fabric are AI-powered assistants that can learn, adapt, and deliver insights instantly, helping teams make better data-driven decisions. Fabric data agents not only retrieve data from OneLake, but they can reason over and understand the data—what it means, how it’s structured, and when it’s relevant. 

Starting today, organizations can use Azure AI Foundry to connect customized, conversational agents, created in Fabric. AI developers can now use Azure AI Agent Service to securely ground AI agent outputs with enterprise knowledge in Fabric data agents, so that responses are accurate, relevant, and contextually aware. By combining Fabric’s sophisticated data analysis over enterprise data with Azure AI Foundry’s cutting-edge GenAI technology, businesses can create custom conversational AI agents leveraging domain expertise. 

“Fabric data agents are a powerful and value-adding tool in data environments. Acting as a conversational capability layer, we can use data agents to ‘talk’ to our data, understand it, and derive different insights in support of our daily decision making.”

—Maureen Tan, Head of AI Center of Expertise, NTT DATA

• Learn how NTT DATA is simplifying their AI deployment.
• Read more about Fabric data agent integration in the Fabric blog and Azure AI blog.
• Check out the following Integrating Fabric with Azure AI Foundry demo to learn more.

Copilot and AI capabilities in Fabric will be available for all SKUs

We are excited to announce that Copilot and AI capabilities will be enabled for all paid SKUs in Fabric, making these tools accessible to everyone within the coming weeks. This expansion is driven by your feedback about the impact Copilot in Microsoft Fabric has had on your productivity, and how broadening access to Copilot would benefit more teams. With this latest update, customers on F2 and above can use Copilot and AI capabilities, such as Fabric data agents, to streamline workflows, generate insights, and drive impactful decisions.

• Read more about these changes in the Copilot for Fabric SKU update blog. 

Seamlessly migrate your data to Fabric 

We are excited to announce the preview of a migration experience natively built into the Fabric UI, enabling Azure Synapse Analytics (data warehouse) customers to transition seamlessly to Microsoft Fabric. With a built-in, intelligent assessment, guided support, and AI-powered assistance, this experience simplifies migration of code and data while helping customers unlock Fabric’s unified data foundation, AI-driven analytics, and enhanced performance—without the complexity of traditional migrations. 

• Read more in the Migration Assistant for Fabric Data Warehouse blog. 

Microsoft Fabric Community Conference

Join us this year in Las Vegas for FabCon 2025.

Explore FabCon now

Additional Fabric innovations

In addition to the above, we are introducing a series of updates across the Microsoft Fabric platform and its workloads. These advancements will further progress our commitments to our four core Fabric pillars: 

Fabric is a complete AI-powered data platform

Fabric is a unified, AI-powered data platform that fosters seamless collaboration across your organization. Today, we’re sharing new enhancements and capabilities that will further strengthen the Fabric platform and workloads, which will unlock even more possibilities for your data initiatives. 

Platform enhancements: 

• The preview of Command Line Interface (CLI) in Fabric introduces a new terminal that allows users and admins to execute commands across Fabric using interactive prompts or scripts, enabling a seamless, code-first experience without relying on clicks. 

• The preview of new CI/CD enhancements expands support across the Fabric platform, including variable libraries for workspaces, Service Principal support for GitHub, and Deployment Pipelines Fabric APIs Phase II. 

• The preview of User Data Functions introduces a way for developers to implement and reuse custom business logic in Fabric data science and data engineering workflows, streamlining development and improving efficiency. 

• The general availability of the Terraform provider for Fabric, to help customers ensure deployments and management tasks are executed accurately and consistently. 

• The general availability of Tags in Microsoft Fabric, which allows users to optimally describe items they own, and help enhance organization and discoverability of data in Fabric. 

Data integration enhancements: 

• Several enhancements to Dataflow Gen2 including the general availability of Incremental Refresh, and the preview to save a Dataflow Gen1 as a Dataflow Gen2. 

• Database Mirroring has been enhanced with key new enterprise capabilities, including a new source (Azure Database for PostgreSQL flexible server) and support for connecting to data sources over the On-premises and Virtual Network Data Gateways. 

• The general availability of Apache Airflow job empowers customers to run their Apache Airflow DAGs in Microsoft Fabric, with a serverless Apache Airflow runtime. 

• The general availability of the Copy job introduces a new simplified experience for customers who need to move data between different data sources and destinations. It also introduces support for batch and incremental data movement. 

• The preview of key orchestration enhancements is now available, enabling the creation of metadata-driven pipelines that orchestrate Dataflow Gen2 (CI/CD) parameterized invocation from Data Pipelines 

• Read more about all the Data Factory enhancements in the What’s new with Fabric Data Factory.

Real-time intelligence enhancements:

• The general availability of Azure and Fabric Events transforms Fabric into an event-driven platform. Users can leverage the Real-Time hub to discover and subscribe to Azure and Fabric Events across OneLake, Fabric jobs, Workspaces, and Azure Blob Storage.

• The preview of new eventstream connectors which allows users to bring in data from additional non-Microsoft sources, including Weather, Solace PubSub+, ADX Table Streamify, MQTT v5, Event Grid Namespaces, and Confluent with Schema Registry. 

• Read more about our Real Time Intelligence enhancements in the Real Time Updates blog.

Data Engineering and Data Science enhancements: 

• The preview of Autoscale Billing for Spark helps optimize Spark job costs by offloading Data Engineering workloads to a serverless billing mode. Capacity admins can set a max capacity units (CUs) limit in capacity settings, ensuring Spark jobs use dedicated CUs instead of shared Fabric Capacity. 

• A new Copilot experience in Fabric notebooks that improves productivity with in-cell interactions, better code generation, and seamless Fabric integration. 

• The preview of AI functions provides powerful capabilities to apply LLM-powered transformations, such as summarization, classification, and text generation to your OneLake data—all with a single line of code.

Partner/ISV integrations 

• At Ignite, we announced the general availability of the Workload Development Toolkit (WDK) and introduced ISV workloads that bring new capabilities and value to our joint customers. We are excited to now announce the general availability of Fabric workloads from Osmos, Profisee, and PowerBI.tips, along with public previews of new workloads from Celonis, CluedIn, Neo4j, Lumel, Statsig, and Striim in the Fabric Workload Hub. In addition, CluedIn also announced a public preview of its integration with Open Mirroring in Fabric.

Fabric is open with an AI-ready data lake 

In addition to OneLake Security, we are also making enhancements to OneLake, including: 

• A modern get-data experience with OneLake catalog integration in Microsoft Excel (in Office Insiders Fast) enables users to explore the OneLake catalog directly from Excel, expanding accessibility beyond the existing Microsoft Teams integration. 

• Coming soon, we are releasing the general availability of on-premises data gateways support for Amazon S3, S3-compatible sources, and Google Cloud Platform allows users to create shortcuts to on-premises data sources hosted behind a firewall or within a Virtual Private Cloud. 

• The enhancements for cross-tenant sharing, including the ability to share multiple tables at once, Lakehouse schemas, as well as tables from Fabric SQL databases, KQL databases, and OneLake shortcuts (coming soon). This shared data can now be accessed via SQL analytics endpoints and semantic models. 

• An updated version of the Fabric Link to Dataverse preview enables even faster and more secure data virtualization from Dataverse, the data platform for the Power Platform and Dynamics 365, thanks to back-end improvements. We are also announcing a new Mirrored Dataverse option in Fabric. Learn more about both announcements. 

• Multi-tenant organization (MTO) support is now generally available.

• CI/CD support for OneLake shortcuts is now in preview.

Fabric empowers every business user with AI capabilities

Fabric empowers business users to quickly uncover key insights in a Power BI report by simply asking Copilot. With AI-enhanced Q&A and intuitive visuals seamlessly embedded in Microsoft 365 apps, everyone can better understand and act on their data with ease. To further empower this mission, we’re announcing that: 

• The preview of Direct Lake semantic models in Power BI desktop, which allows users to build Power BI semantic models for lightning-fast reports that query data directly from OneLake without scheduling refreshes and without data duplication. This feature will also enable users to add in tables from multiple Fabric artifacts in the same Direct Lake semantic model for ultimate reusability of OneLake data.

• The preview of Datapoint annotations in Power BI add-in for Microsoft PowerPoint, which allows users to add descriptive text to a specific data point within a visualization.

Fabric provides a mission-critical foundation 

Our final promise is that you can confidently deploy and manage Microsoft Fabric with category-leading performance, instant scalability, shared resilience, and built-in security, governance, and compliance. To further that mission, we’re excited to introduce several enhancements to our mission-critical promise, including: 

Mission-critical foundation enhancement with Microsoft Purview:

• Coming soon, the preview of Microsoft Purview for Copilot in Power BI. The integration will enable discovery of data risks such as sensitive data in user prompts and responses, protect sensitive data with Insider Risk Management to identify and investigate risky AI usage, and govern AI usage with audit, eDiscovery, retention policies, and non-compliant usage detection.  

• Coming soon, we are expanding Purview Data Loss Prevention policies Fabric coverage beyond lakehouses and semantic models, to now also include Fabric KQL databases and mirrored databases. This will allow security admins to detect sensitive data uploads, such as SSNs, and trigger automated actions in more sources. 

• The preview of Data Observability within the Unified Catalog to investigate the relationship between data products and any assets (including Fabric assets) associated with them to identify the root cause of quality issues. 

• Read more in the secure and govern your data with Microsoft Purview blog.

Getting started with Microsoft Fabric 

New customers can try out everything Fabric has to offer by signing up for a free 60-day trial—no credit card information required. Learn how to start your free Microsoft Fabric trial. 

If you’re considering purchasing Fabric and need help choosing a SKU, we’re excited to share that a new Fabric SKU Estimator will soon be available in public preview. Stay tuned. 

Watch the action at the Fabric Conference

To see these announcements in action, register and secure your spot today through Wednesday April 2, 2025. With over 200 expert-led sessions, you can join thousands of attendees who are diving deep into Microsoft Fabric, exploring innovations in AI, databases, analytics, business intelligence, and more.  

Explore additional resources for Microsoft Fabric 

To learn more about Fabric:  

• Sign up for the Fabric free trial.
• View the updated Fabric Roadmap.
• Visit the Fabric website.
• Join the Fabric community.
• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog.
• See how the Microsoft IDEAS team is building on Fabric. 
• Explore the Fabric technical documentation. 
• Check out the newly launched Fabric Tech Talk Fridays (F²T²), which is the go-to show for Fabric MVPs, users, and fans. Join us for live demos, real use cases, and expert insights. Watch the latest Fabric Tech Talk Fridays episodes. 

Read additional blogs by industry-leading partners: 

• The Future of Microsoft Fabric and Enterprise Innovation by PricewaterhouseCoopers LLP (PWC). 
• How to navigate the complexity of data supply chains by Ernst & Young Global Limited (EY). 
• How Microsoft is making data platforms smarter by Hitachi Solutions. 
• Healthcare Innovation with Microsoft Fabric and Microsoft Fabric meets Agentic AI by Sonata Software. 
• Unlocking business potential with Microsoft Fabric by Eide Bailly. 
• A comprehensive solution for Healthcare on Microsoft Fabric by Mandelbulb Technologies. 
• Microsoft Fabric raises the bar again by Kanerika Software. 
• Implementing Data Agents in Microsoft Fabric and integrating predictive analytics into Power BI and Migrating from On-Prem SQL to Microsoft Fabric by Baker Tilly US, LLP. 
• Fabric Copilot is now available for all SKUs! by RSM US, LLP. 
• Smart Manufacturing: Unlocking Real-Time Intelligence with Azure IoT Operations and Microsoft Fabric by b.telligent. 

The post FabCon 2025: Fueling tomorrow’s AI with new agentic capabilities and security innovations in Fabric  appeared first on Microsoft Fabric Blog.

With Fabric, we focused on simplicity, openness, and autonomy. All Fabric workloads work together seamlessly out-of-the-box without the myriad of infrastructure and configuration settings you typically find in data platforms so you can focus on getting results. You can ingest structured and unstructured data in any format into OneLake’s open Delta Parquet format and even access third-party tools from industry leading software companies built directly into Fabric. Advanced security, governance, and continuous integration and continuous delivery (CI/CD) capabilities are woven into the platform with personalized experiences for admins and users alike. Microsoft Copilot and other AI capabilities are built into every layer of Fabric to help data professionals and business users automate routine tasks and get more done. In fact, we’ve found that users were 52% faster in completing standard data analysis tasks and uncovered insights 36% more accurately when using Copilot in Fabric, with 90% saying they were likely to adopt Copilot in Fabric.¹  

Fabric’s vision for a data platform has highly resonated with the industry, and more than 17,000 customers, including 70% of the Fortune 500, are already using Fabric to empower their data teams.

• Melbourne Airport, the second busiest in Australia, used Fabric to analyze their operational data in real-time and gained 30% increased performance efficiency across data-related operations. “It’s a radical and powerful new technology that can feel just like using Microsoft Excel or Power BI. But once in the hands of the user, it doesn’t feel like a new, complex technology at all,” Irfan Khan, Head of Data and Analytics.  
• Chanel, a world leader in luxury fashion, adopted Fabric not only to drive more value from its data and support their AI innovation, but also safeguard its data at rest and in-transit with Fabric’s end-to-end, built-in security, governance, and reliability. “We chose Microsoft Fabric as the foundation of this platform, driven by its ability to implement a data mesh approach,” Olivier Barbonnat, Chief Information Officer Europe.  
• Our own Microsoft IDEAS (insights, data, engineering, analytics, systems) team, one of the largest data teams in the world, transitioned to Fabric to support its AI ambitions. Its solution now encompasses 27,000 data sources, 420 petabytes of data, 35,000 data pipelines, 38,000 semantic models, and more than 600 teams relying on its models. The IDEAS team estimated it has received a 50% efficiency boost from consolidating assets in OneLake, using modern tools such as Spark and Python, Direct Lake mode in Microsoft Power BI, and AI-assisted coding through IDEAS Copilot.

Schaeffler, Hitachi Solutions, KPMG, Epic, and many other customers have seen a transformational impact to how they process data. You can explore all these Fabric stories on the Microsoft Customer Stories page. One of the reasons Fabric caught the imagination of so many is because, with Fabric, you can simplify and future-proof your data estate. Fabric’s capabilities and workloads will continue to expand and be seamlessly infused into our pre-integrated platform, helping you keep up with the technology trends without added work.  

And since launching Fabric, we’ve added new ways to bring data into Fabric with capabilities like mirroring and new shortcut sources. We’ve expanded Copilot in Fabric across almost every experience to help everyone automate routine tasks. We’ve added a multitude of security and governance features to help you make sure your data is secure at every step of its journey. We’ve added the ability to extend Fabric further with native, industry-specific workloads from Microsoft and other software developers. And most impactfully, we launched a new workload to help organizations make better decisions from Internet of Things (IoT), logs, and telemetry data—Real-Time Intelligence.  

With Fabric Real-Time Intelligence, we transformed Fabric into a platform equipped to support your operational scenarios and data in motion. And now, we’re helping you bring transactional scenarios to Fabric with the introduction of Fabric Databases. 

Introducing a unified data platform with Fabric Databases

Currently, the data and AI technology market is massively fragmented with hundreds of vendors and thousands of services. We believe the future of data and AI is the convergence of all your data services into a unified, open, and extensible platform, so you no longer have to manually stitch together disconnected services.  

Today, we’re thrilled to announce a major leap toward this goal with Fabric Databases, now in preview. Fabric Databases represent a new class of cloud databases that brings a world-class transactional database natively to Microsoft Fabric for app developers. With the addition of Fabric Databases, Fabric now brings together both transactional and analytical workloads, creating a truly unified data platform. Developers can streamline application development with simple, autonomous, and AI-optimized databases that provision in seconds and are secured by default with features like cloud authentication and database encryption. Built-in vector search, retrieval augmented generation (RAG) support, and Azure AI integration simplify AI app development, and your data is instantly available in OneLake for advanced analytics. Developers can even use Copilot in Fabric to translate natural language queries into SQL and get inline code completion alongside code fixes and explanations.

SQL database, the first available in Fabric, was built on our industry-leading SQL Server engine and the simple and intuitive SaaS platform of Fabric. In fact, data professionals who’ve tried SQL database in Fabric were able to complete common database tasks up to 71% faster and with 63% more effective task completion. They reported feeling 84% more confident in these tasks and finding the tasks up to 91% less difficult.²  These results were even more pronounced for people who were newer to cloud. Those with less than two years of cloud platform experience benefited the most in terms of efficiency and effectiveness, highlighting the simplicity and intuitiveness of Fabric Databases. 

SQL database is just the beginning for Fabric Databases, with more databases on the roadmap. Whether you’re an experienced data professional or just getting started, you can build AI apps faster and more confidently on Fabric Databases.

To learn more, read the Fabric Databases blog post, watch the Microsoft Mechanics deep dive video, and watch the following sizzle video:

General availability of Fabric Real-Time Intelligence

We’re also thrilled to announce Real-Time Intelligence is now generally available. With Real-Time Intelligence, you get both pro-dev and no-code tools to ingest high-volume streaming data with high granularity, dynamically transform streaming data, query data in real-time for instant insights, and trigger automated actions based on the data. The Real-time hub provides a central place to discover and manage all your streaming data. Dener Motorsport, a participant in the annual Porsche Carrera Cup Brasil event, used Real-Time Intelligence for in-race analytics, and their CEO, Dener Pires, said “Before we used Microsoft Fabric and Real-Time Intelligence, it was probably 30 minutes before the engineers knew that something was wrong with a car, could get the data, analyze it, and provide a solution. Today that process is done in minutes.” Check out this blog post and the following demo to see Real-Time Intelligence in action: 

OneLake catalog—a complete catalog for discovery, management, and governance

No matter what data project you’re trying to accomplish, it starts with the right foundation. OneLake, Fabric’s unified, multi-cloud data lake, is built for everyone in your entire organization as the single point to discover and explore your data. With OneLake shortcuts and mirroring, you can unify all of your multi-cloud and on-premise sources and enable your people to work from the same data—meaning fewer copies of data, better collaboration between your teams, and easier, more streamlined analysis. And since data is stored in an open format, you can use data in OneLake for all your data projects, no matter the vendor or service.  

Today, we’re excited to announce the OneLake catalog, a complete solution to explore, manage, and govern your entire Fabric data estate. The OneLake catalog comes with two tabs, Explore and Govern, that can help all Fabric users discover and manage trusted data, as well as provide governance for data owners with valuable insights, recommended actions, and tooling. Since the OneLake catalog is an evolution of the OneLake data hub, it already shows up in Microsoft 365, such as in Excel and Microsoft Teams and many other products in the Microsoft cloud for easy data consumption. OneLake catalog value can be extended to the Microsoft Purview data governance solution, Unified Catalog, which offers the data office, data stewards, and data owners advanced governance capabilities, including data quality and a global catalog for the heterogeneous data estate. The Explore tab is now generally available, and the Govern tab will be coming soon in preview.  

Learn more about the OneLake catalog by reading this blog post and by watching the following demo:

More Fabric innovation

The introduction of Fabric Databases and the growing opportunity with generative AI in accelerating data projects has encouraged us to reimagine the pillars of Fabric. We are now focused on making sure Fabric can provide you with: 

• An AI-powered data platform. Fabric can give your teams the AI-powered tools needed for any data project in a pre-integrated and optimized SaaS environment. You can even extend Fabric further by adding other native workloads from the Workload Hub, created by industry-leading partners.  
• An open and AI-ready data lake. Fabric can help you access your entire multi-cloud data estate from a single data lake, work from the same copy of data across analytics engines, and ensure your data is ready to power AI innovation.  
• AI-enabled business users. Fabric can empower everyone to better understand your data with AI-enhanced Q&A experiences and visuals embedded in the Microsoft 365 apps they use every day. 
• A mission-critical foundation. You can confidently deploy and manage Fabric with category-leading performance, instant scalability, shared resilience, and built-in security, governance, and compliance. 

Check out the new Fabric sizzle video to see these pillars in action: 

We’re excited to share a huge slate of announcements designed to help us better accomplish each goal above. These enhancements include: 

Fabric workload enhancements

• The general availability of sustainability data solutions in Microsoft Fabric, a single place for all your environmental, social, and governance (ESG) data needs. Julie Nikulina, IT Solutions Engineer at Schaeffler AG, a global automotive and industrial supplier, mentioned that, “thanks to Microsoft Fabric, we’ll be able to answer lots of questions about climate neutrality and decarbonization company-wide via a single platform—and we can implement new use cases in short sprints within two to six weeks.”  
• Coming soon, the preview of AI functions in Fabric notebooks, which provide a simplified API for common AI text enrichments like summarization, translation, sentiment analysis, and more. 
• The general availability of API for GraphQL, which is an API to help you access data from multiple sources in Fabric with a single query API. 
• The preview of several enhancements to Fabric Real-Time Intelligence, which include new Fabric events, enhancements to Eventstreams and Eventhouses, and easier real-time dashboard sharing. 
• The preview of the Copilot in Fabric experience for data pipelines in Fabric Data Factory. 
• The preview of our integration with Esri ArcGIS for advanced spatial analytics. 

Microsoft OneLake enhancements

• The preview of open mirroring, a feature that allows any application or data provider to write change data directly into a mirrored database within Fabric. 
• The general availability of Azure SQL DB mirroring and the preview of SQL MI mirroring. 

New AI capabilities in Fabric

• Coming soon, the preview of AI skill enhancements, including a more conversational experience and support for semantic models and Eventhouse KQL databases. 
• Coming soon, the preview of AI skill integration with Agent Service in the newly announced Azure AI Foundry, allowing developers to use AI skills as a core knowledge source. 

Platform-wide enhancements

• The preview of workspace monitoring, which provides detailed diagnostic logs for workspaces to troubleshoot performance issues, capacity performance, and data downtime. 
• The general availability of the Workload Development Kit, created to help software developers design, build, and interoperate applications within Fabric. We’re excited to see many of our industry-leading partners announce preview of their workload hub offerings, including Quantexa, SAS, Teradata, Osmos, Esri, and Profisee. 
• The preview of further integration with Microsoft Purview including extending Protection policies to enforce access permissions to more sources and using Data Loss Prevention policies to restrict access to semantic models with sensitive data. 
• The general availability of external data sharing allows you to directly share OneLake tables and folders with other Fabric tenants in an easy, quick, and secure manner. 
• Fabric is FedRAMP High certified for the Azure Commercial cloud, the highest level of compliance and security standards required by the federal government for cloud service providers. Now government agencies can run Fabric on the Azure Commercial cloud while maintaining strict compliance. 

You can learn more about all of these announcements and so much more in the Fabric November 2024 Update blog post and the numerous blog posts that will go live throughout this week on the Fabric blog channel.  

Fabric billing and consumption updates

Finally, we’re making some important changes to Fabric’s billing model. First, coming soon, organizations with multiple capacities can now direct Copilot in Fabric consumption and billing to a specific capacity, no matter where the Copilot in Fabric usage actually takes place. Admins can assign specific members of their organization to the specified F64 or higher capacity for all of their Copilot requests. These requests will be consumed and billed on that assigned F64+ capacity, ensuring Copilot in Fabric usage doesn’t impact priority jobs while expanding Copilot access to any workspace regardless of its capacity.

Additionally, we’re providing capacity admins with more control over the Fabric jobs running in their capacities. Surge protection, now in preview, helps protect capacities from unexpected surges in background workload consumption. Admins can use surge protection to set a limit on background activity consumption, which will prevent background jobs from starting when reached. Admins can configure different limits for each capacity in your organization to give you the flexibility to meet your needs.

Watch Fabric in action at Microsoft Ignite

Join us at Microsoft Ignite 2024 from November 19 to November 21, 2024 to see all of these announcements in action across the following sessions:  

• “Microsoft Fabric: What’s new and what’s next” with Arun Ulagaratchagan and Amir Netz
• “Power AI apps with unified data and insights in Microsoft Fabric” with Panos Antonopoulos, Anna Hoffman, and Asad Khan 
• “Ingest, govern, and secure your data with OneLake” with Josh Caplan, Wilson Lee, and Adi Regev 
• “Unlock the power of Real-Time Intelligence in the era of AI” with Yitzhak Kesselman, Tessa Kloster, Niraj Revankar, Vijay Sankaran, and Ksenia Suresh. 

And six other Fabric breakout sessions. You can also join us at labs and theater sessions throughout the event. Find all the data-related sessions at Ignite. You can also learn about other announcements across our Azure portfolio by reading these blogs by Jessica Hawk and Omar Khan. 

• The next wave of Azure innovation: Azure AI Foundry, intelligent data, and more: We’re bringing a huge range of innovation to our AI platform including the new Azure AI Foundry, a unified platform designed to empower both developers and business decision-makers in the age of AI. 
• Scale your AI transformation with a powerful, secure, and adaptive cloud infrastructure: We’re also announcing cloud and AI infrastructure announcements, from advancements in chips and liquid cooling to new data integrations and more flexible cloud deployments.  

Finally, if you want more strategic guidance to help you along your data and analytics journey in the era of AI, you should watch the recent Data and Analytics Forum.

Getting started with Microsoft Fabric

New customers can try out everything Fabric has to offer by signing up for a free 60-day trial—no credit card information required. Learn how to start your free trial.  

If you’re considering purchasing Fabric and need help deciding on a SKU, we’re excited to share a new Fabric SKU estimator, now in private preview. You can sign up to try out this tool as part of the early adopter program—try the SKU estimator.

Start building your Fabric skills

Be one of the first to start using Fabric Databases

Ready to build reliable, highly scalable applications where cloud authentication and encryption are secured by default? Starting December 3, 2024, join live sessions with database experts and see just how easy it is to get started. View the schedule and register for the series.

Get certified in Microsoft Fabric—for free

Get ready to fast-track your career by earning your Microsoft Certified: Fabric Analytics Engineer Associate certification. For a limited time, we’re offering 5,000 free DP-600 exam vouchers to eligible Fabric community members. Complete your exam by the end of the year and join the ranks of certified experts. Don’t miss this opportunity to get certified. 

A new Fabric certification for data engineers

We’re excited to announce a brand-new certification for data engineers. The new Microsoft Certified: Fabric Data Engineer Associate certification will help you demonstrate your skills with data ingestion, transformation, administration, monitoring, and performance optimization in Fabric. To earn this certification, pass Exam DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric, currently in beta.

Join us at the 2025 Microsoft Fabric Community Conference

Looking to gain hands-on experience with Fabric and learn directly from the people who created it? If so, join us from March 29 to April 3, 2025, at the Microsoft Fabric Community Conference in Las Vegas, Nevada. Register today. 

Explore additional resources for Microsoft Fabric

If you want to learn more about Fabric:  

• Sign up for the Fabric free trial. 
• Register for the Microsoft Data and Analytics Forum. 
• View the updated Fabric Roadmap. 
• Visit the Fabric website. 
• Join the Fabric community. 
• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog. 
• Explore the Fabric technical documentation.

Read additional blogs by industry-leading partners:

• “Data Governance in Microsoft Fabric with Microsoft Purview,” by CloudThat Technologies Pvt. Ltd.
•  “Key Fabric Announcements and Overview of Fabric Databases,” by Telefónica Tech.
• “Ignite 2024 – Microsoft Fabric announcements: the continued convergence of data platform and analytics to deliver intelligent insights,” by BJSS. 
• “Architecting tomorrow—A Microsoft Fabric Blueprint to intelligent enterprise covering Fabric Databases, AI Skills, Fabric and Microsoft Purview, Apache Iceberg support in OneLake,” by Avasoft Inc.
• “Microsoft Fabric Databases,” “Microsoft Fabric’s AI Skills,” and “Data Engineering: Liquid Clustering in Fabric,” by Verne Tech.
• “A First Look at Fabric Mirroring for SQL Managed Instance,” by Coeo Ltd.
• “Leveraging Microsoft Fabric for Dynamics 365 with Dataverse,” and “Automating Data Workflows in Microsoft Fabric: A Low-Code/No-Code Approach,” by PreludeSys.
• “Enabling self-service for supply chain analytics with Microsoft Fabric and Direct Lake,” “Transforming data operations with Microsoft Fabric and CI/CD for ISVs,” and “How Microsoft Fabric transformed data analytics for an ISV with Real-Time Intelligence,” by MAQ Software.
• “Real Time Intelligence for the Rest of Us with Microsoft Fabric,” by iLink Digital.       

¹Based upon n=209 user studies conducted by Microsoft Corporation in October 2024 that measured four common metrics associated with the consumption experience of Power BI in Microsoft Fabric. Qualitative sentiment gathered upon task completion. The actual results may vary. 

²Based upon n=210 user studies conducted with technical practitioners by Microsoft Corporation in October 2024 that measured time to complete four common tasks associated with AI application development on a SQL database in Microsoft Fabric and on Azure SQL Database. Actual results may vary based upon individual performance and sentiment.

The post Accelerate app innovation with an AI-powered data platform appeared first on Microsoft Fabric Blog.

Thank you to everyone joining us at the first annual European Microsoft Fabric Community Conference this week in Stockholm, Sweden! Besides seeing the beautiful views of Old Town, attendees are getting an immersive analytics and AI experience across 120 sessions, 3 keynotes, 10 workshops, an expo hall, community lounge, and so much more. They are seeing firsthand the latest capabilities we are bringing to the Fabric platform. For those unable to attend, this blog will highlight the most significant announcements that are already changing the way our customers interact with Fabric. 

Microsoft Fabric

Learn how to set up Fabric for your business and discover resources that help you take the first steps

Try Fabric today

Over 14,000 customers have invested in the promise of Microsoft Fabric to accelerate their analytics including industry-leaders like KPMG, Chanel, and Grupo Casas Bahia. For example, Chalhoub Group, a regional luxury retailer with over 750 experiential retail stories, used Microsoft Fabric to modernize its analytics and streamline its data sources into one platform, significantly speeding up their processes.

“It’s about what the technology enables us to achieve—a smarter, faster, and more connected operational environment.”

—Mark Hourany, Director of People Analytics, Chalhoub Group

Check out the myriad ways customers are using Microsoft Fabric to unlock more value from their data:

New capabilities coming to Microsoft Fabric

Since launching Fabric, we’ve released thousands of product updates to create a more complete data platform for our customers. And we aren’t slowing down anytime soon. We’re thrilled to share a new slate of announcements that are applying the power of AI to help you accelerate your data projects and get more done.

Specifically, these updates are focused on making sure Fabric can provide you with: 

1. AI-powered development: Fabric can give teams the AI-powered tools needed for any data project in a pre-integrated and optimized SaaS environment.

2. An AI-powered data estate: Fabric can help you access your entire multi-cloud data estate from a single, open data lake, work from the same copy of data across analytics engines, and use that data to power AI innovation 

3. AI-powered insights: Fabric can empower everyone to better understand their data with AI-powered visuals and Q&A experiences embedded in the Microsoft 365 apps they use every day. 

Let’s look at the latest features and integrations we are announcing in each of these areas. 

AI-powered development

With Microsoft Fabric, you have a single platform that can handle all of your data projects with role-specific tools for data integration, data warehousing, data engineering, data science, real-time intelligence, and business intelligence. All of your data teams can work together in the same pre-integrated, optimized experience, and get started immediately with an intuitive UI and low code tools. All the workloads access the same unified data lake, OneLake, and work from a single pool of capacity to simplify the experience and ease collaboration. With built-in security and governance, you can secure your data from any intrusion and ensure only the right people have access to the right data. And as we continue to infuse Copilot and other AI experiences across Fabric, you can not only use Fabric for any application, but also accelerate time to production. In the video below, check out how users can take advantage of Copilot to create end-to-end solutions in Fabric: 

Today, I’m thrilled to share several new enhancements and capabilities coming to the platform and each workload in Fabric.

Fabric platform

We’re building platform-wide capabilities to help you more seamlessly manage DevOps, tackle projects of any scale and complexity. First, we’re updating the UI for deployment pipelines, in preview, to be more focused, easier to navigate, and have a smoother flow, now in preview. Next, we’re introducing the Terraform provider for Fabric, in preview, to help customers ensure deployments and management tasks are executed accurately and consistently. The Terraform provider enables users to automate and streamline deployment and management processes using a declarative configuration language. We are also adding support for Azure service principal in Microsoft Fabric REST APIs to help customers automate the deployment and management of Fabric environments. You can manage principal permissions for Fabric workspaces, as well as the creation and management of Fabric artifacts like eventhouses and lakehouses.

We’re excited to announce the general availability of Fabric Git integration. Sync Fabric workspaces with Git repositories, leverage version control, and collaborate seamlessly using Azure DevOps or GitHub. We are also extending our integration with Visual Studio Code (VS Code). You can now debug Fabric notebooks with the web version of VS Code and integrate Fabric environments as artifacts with the Synapse VS Code extension—allowing you to explore and manage Fabric environments from within VS Code. To learn more about these updates, read the Fabric September 2024 Update blog.

Security and governance

To help organizations govern the massive volumes of data across their data estate, we’re adding more granular data management capabilities including item tagging and enhancements to domains—both of which are now in preview. We’re introducing the ability to apply tags to Fabric items, helping users more easily find and use the right data. Once applied, data consumers can view, search, and filter by the applied tags across various experiences. We’re also enhancing domains and subdomains with more controls for admins including the ability to define a default sensitivity label, domain level export and sharing settings, and insights for admins, on tenant domains. Finally, for data owners, we’re adding the ability to search for data by domain, to filter workspaces by domain, and to view domain details in a data item’s location.

Over the past year, we’ve launched a myriad of security features designed to secure your data at every step of the analytics journey. Two of our network security features, trusted workspace access, and managed private endpoints, were previously only available in F64 or higher capacities. We’re excited to share that, based on your feedback, we are making these features available in all Fabric capacities. We’re also making managed private endpoints available in trial capacities as part of this release.

We’re also announcing deeper integration with Microsoft Purview, Microsoft’s unified data security, data governance, and compliance solution. Coming soon, security admins will be able to use Microsoft Purview Information Protection sensitivity labels to manage who has access to Fabric items with certain labels—similar to Microsoft 365. Also coming soon, we are extending support for Microsoft Purview Data Loss Prevention (DLP) policies, so security admins can apply DLP policies to detect the upload of sensitive data, like social security numbers, to a lakehouse in Fabric. If detected, the policy will trigger an automatic audit activity, can alert the security admin, and can even show a custom policy tip to data owners to remedy themselves. These capabilities will be available at no additional cost during preview in the near term, but will be part of a new Purview pay-as-you-go consumptive model, with pricing details to follow in the future. Learn more about how to secure your Fabric data with Microsoft Purview by watching the following video: 

You can also complement and extend the built-in governance in Fabric by seamlessly connecting your Fabric data to the newly reimagined Purview Data Governance solution—now generally available. This new solution delivers an AI-powered, business-friendly, and unified solution that can seamlessly connect to data sources within Fabric and across your data estate to streamline and accelerate the activation of your modern data governance practice. Purview integrations enable Fabric customers to discover, secure, govern, and manage Fabric items from a single pane of glass within Purview for an end-to-end approach to their data estate. Learn more about these Microsoft Purview innovations.  

Workload enhancements and updates

We’re also making significant updates across the six core workloads in Fabric: Data Factory, Data Engineering, Data Warehouse, Data Science, Real-Time Intelligence, and Microsoft Power BI.

Data Factory

In the Data Factory workload, built to help you solve some of the most complex data integration scenarios, we are simplifying the data ingestion experience with copy job, transforming the dataflow capability, and releasing enhancements for data pipelines. With copy job, now in preview, you can ingest data at petabyte scale, without creating a dataflow or data pipeline. Copy job supports full, batch, and incremental copy from any data sources to any data destinations. Next, we are releasing the Copilot in Fabric experience for Dataflows Gen2 into general availability—empowering everyone to design dataflows with the help of an AI-powered expert. We’re also releasing Fast Copy in Dataflows Gen2 into general availability, enabling you to ingest large amounts of data using the same high-performance backend for data movement used in Data Factory (e.g., “copy” activity in data pipelines, or copy job). Lastly for Dataflows Gen2, we are introducing incremental refresh into preview, allowing you to limit refreshes to just new or updated data to reduce refresh times.

Along with the dataflow announcements, we’re announcing an array of enhancements for data pipelines in Fabric, including the general availability of the on-premises data gateway integration, the preview of Fabric user data functions in data pipelines, the preview of invoke remote pipeline to call Azure Data Factory (ADF) and Synapse pipelines from Fabric, and a new session tag parameter for Fabric Spark notebook activity to enable high-concurrency Notebook runs. Additionally, we’ve made it easier to bring ADF pipelines into Fabric by linking your existing pipelines to your Fabric workspace. You’ll be able to fully manage your ADF factories directly from the Fabric workspace UI and convert your ADF pipelines into native Fabric pipelines with an open-source GitHub project. 

Data Engineering

For the Data Engineering workload, we’re updating the native execution engine for Fabric Spark and releasing upgraded Fabric Runtime 1.3 into general availability. The native execution engine enhances Spark job performance by running queries directly on lakehouse infrastructure, achieving up to four times faster performance compared to traditional Spark based on the TPC-DS 1TB benchmark. The native execution engine can now, in preview, support Fabric Runtime 1.3, which together can further enhance the performance of Spark jobs and queries for both data engineering and data science projects. This engine has been completely rewritten to offer superior query performance across data processing; extract, transform, load (ETL); data science, and interactive queries. We are also excited to announce a new acceleration tab and UI enablement for the native execution engine.

Additionally, we are announcing an extension of support in Spark to mirrored databases, providing a consistent and convenient way to access and explore databases seamlessly with the Spark engine. You can easily add data sources, explore data, perform transformations, and join your data with other lakehouses and mirrored databases. Finally, we are excited to launch T-SQL notebooks into public preview. The T-SQL notebook enables SQL developers to author and run T-SQL code with a connected Fabric data warehouse or SQL analytics endpoint, allowing them to execute complex T-SQL queries, visualize results in real-time, and document analytical process within a single, cohesive interface. 

Data Warehouse

We are excited to announce the Copilot in Fabric experience for Data Warehouse is now in preview. This AI assistant experience can help developers generate T-SQL queries for data analysis, explain and add in-line code comments for existing T-SQL queries, fix broken T-SQL code, and answer questions about general data warehousing tasks and operations. Learn more about the Copilot experience for Data Warehouse here. And as mentioned above, we are announcing T-SQL notebooks—allowing you to create a notebook item directly from the data warehouse editor in Fabric and use the rich capabilities of notebooks to run T-SQL queries.

Real-Time Intelligence

In May 2024, we launched a new workload called Real-Time Intelligence that combined Synapse Real-Time Analytics and Data Activator with a range of additional new features, currently in preview, to help organizations make better decisions with up-to-the-minute insights. We are excited to share new capabilities, all in preview, to help you better ingest, analyze, and visualize your real-time data.

First, we’re announcing the launch of the new Real-Time hub user experience; a redesigned and enhanced experience with a new left navigation, a new page called “My Streams” to create and access custom streams, and four new eventstream connectors: Azure SQL Managed Instance – change data capture (MI CDC), SQL Server on Virtual Machine – change data capture (VM CDC), Apache Kafka, and Amazon MSK Kafka. These new sources empower you to build richer, more dynamic eventstreams in Fabric. We’re also enhancing eventstream capabilities by supporting eventhouse as a new destination for your data streams. Eventhouses, equipped with KQL databases, are designed to analyze large volumes of data, particularly in scenarios that demand real-time insight and exploration.

We’re also pleased to announce an upgrade to the Copilot in Fabric experience in Real-Time Intelligence, which translates natural language into KQL, helping you better understand and explore your data stored in Eventhouse. Now, the assistant supports a conversational mode, allowing you to ask follow-up questions that build on previous queries within the chat. With the addition of multi-variate anomaly detection, it’s even easier to discover the unknowns in your high-volume, high-granularity data. You can also have Copilot create a real-time dashboard instantly based on the data in your table, providing immediate insights you can share in your organization.

Finally, we are upgrading the Data Activator experience to make it easier to define a variety of rules to act in response to changes in your data over time, and the richness of our rules have improved to include more complex time window calculations and responding to every event in a stream. You can set up alerts from all your streaming data, Power BI visuals, and real-time dashboards and now even set up alerts directly on your KQL queries. With these new enhancements, you can make sure action is taken the moment something important happens.

Learn more about all of these workload enhancements in the Fabric September 2024 Update blog.

Power BI

We’re thrilled to announce new capabilities across Power BI that will make it easier to track and use the KPIs that matter most to you, create organizational apps, and work with Direct Lake semantic models. 

First, we are announcing the preview of Metric sets which will allow users to promote consistent and reliable metrics in large organizations across Fabric, making it easier for end users to discover and use standardized metrics from corporate models. With Metric sets, trusted creators within an organization can develop standardized metrics, which incorporate essential business logic from Power BI. These creators can organize the metrics into collections, promote and certify them, and make them easily discoverable for end users and other creators. These endorsed and promoted metrics can then be used to build Power BI reports, improving data quality across the organization, and can also be reused in other Fabric solutions, such as notebooks.

We’re improving organizational apps in Power BI, a key tool for packaging and securely distributing Power BI reports to your organization. Now in preview, you can create multiple organizational apps in each workspace, and they can contain other Fabric items like notebooks and real-time dashboards. The app interface can even be customized, giving you more control over the color, navigation style, and landing experience.

We’re also making it easier to work with Direct Lake semantic models with new version history for semantic models, similar to the experience found across the Microsoft 365 apps. Power BI users can also now live edit Direct Lake semantic models right from Power BI Desktop. And we’re excited to announce a capability widely asked for by Power BI users: a dark mode in Power BI Desktop. 

Finally, we’re announcing the general availability of OneLake integration for semantic models in Import mode. OneLake integration automatically writes data imported into your semantic models to Delta Lake tables in OneLake so that you can enjoy the benefits of Fabric without any migration effort. Once added to a lakehouse in OneLake, you can use T-SQL, Python, Scala, PySpark, Spark SQL, or R on these Delta tables to consume this data and add business value. All of this value comes at no additional cost as data stored in OneLake for Power BI import semantic models is included in the price of your Power BI licensing.

Learn more about the Power BI announcements in the Power BI September 2024 Feature blog. Also see the AI-powered insights section below for new Copilot experiences for Power BI creators and consumers.

AI-powered data estate

With OneLake, Fabric’s unified data lake, you can create a truly AI-powered data estate to fuel your AI innovation and data culture. OneLake’s shortcuts and mirroring capabilities enable you to access your entire multi-cloud data estate from a single, intuitively organized data lake. With your data in OneLake, you can then work from a single copy across analytics engines, whether you are using Spark, T-SQL, KQL, or Analysis Services and even access that data from other apps like Microsoft Excel or Teams. Today, we are thrilled to share even more capabilities and enhancements coming to OneLake that can help you better connect to and manage your data estate.

One of the biggest benefits of OneLake is the ability to create shortcuts to your data sources, which virtualizes data in OneLake without moving or duplicating it. We are pleased to announce that shortcuts for Google Cloud Services (GCS) and S3-compatible sources are now generally available. These shortcuts also support the on-premise data gateway, which you can use to connect to your on-premise S3 compatible sources as well as GCS buckets that are protected by a virtual private cloud. We’ve also made enhancements to the REST APIs for OneLake shortcuts, including adding support for all current shortcut types and introducing a new list operation. With these improvements, you can programmatically create and manage your OneLake shortcuts.

We’re also excited to announce further integration with Azure Databricks with the ability to access Databricks Unity Catalog tables directly from OneLake—now in preview. Users can just provide the Azure Databricks workspace URL and select the catalog, and Fabric creates a shortcut for every table in the selected catalog, keeping the data in sync in near real-time. Once your Azure Databricks Catalog item is created, it behaves the same as any other item in Fabric, so you can access the table through SQL endpoints, notebooks, or Direct Lake mode for Power BI reports. Learn more about the OneLake shortcut and Azure Databricks announcements in the Fabric September 2024 Updates blog.

At Microsoft Build last May, we announced an expanded partnership with Snowflake that gives our customers the flexibility to easily connect and work across our tools. Today, I’m excited to share progress on this partnership with the upcoming preview of shortcuts to Iceberg tables. In the coming weeks, Microsoft Fabric engines will be able to consume Iceberg data with no movement or duplication using OneLake shortcuts. Simply point to an Iceberg dataset from Snowflake or another Iceberg-compatible service, and OneLake virtualizes the table as a Delta Lake table for broad compatibility across Fabric engines. This means you can work with a single copy of your data across Snowflake and Fabric. With the ability to write Iceberg data to OneLake from Snowflake, Snowflake customers will have the flexibility to store Iceberg data in OneLake and use it across Fabric.

Finally, we’ve released mirroring support for Snowflake databases into general availability—providing a seamless, no-ETL experience for integrating existing Snowflake data with the rest of your data in Microsoft Fabric. With this capability, you can continuously replicate Snowflake data directly into Fabric OneLake in near real-time, while maintaining strong performance on your transactional workloads. Learn more about Snowflake mirroring in Fabric.

AI-powered insights

With your data teams using the AI-enhanced tools in Fabric to accelerate development of insights across your data estate, you then need to ensure these insights reach those who can use them to inform decisions. With easy-to-understand Power BI reports and AI-powered Q&A experiences, Fabric bridges the gap between data and business results to help you foster a culture that empowers everyone to find data-driven answers.

We’re announcing a richer Copilot experience in Power BI to help create reports in a clearer, more transparent way. This new experience, now in preview, includes improved conversational abilities between you and Copilot that makes it easier to provide more context to Copilot initially so you can get the report you need on the first try. Copilot will even provide report outlines to improve transparency on data fields being used. We are also releasing the ability to auto-generate descriptions for measures into general availability. Lastly, report viewers can now use Copilot to summarize a report or page right from the Power BI mobile app, now in preview.

We’re also enhancing email subscriptions for reports by extending dynamic per recipient subscriptions to include both paginated and Power BI reports. With dynamic subscriptions, you can set up a single email subscription that delivers customized reports to each recipient based on the data in the semantic model. For reports that are too large for email format, we are also giving you the ability to deliver Power BI and paginated report subscriptions to a OneDrive or SharePoint location for easy access. Finally, you can now create print-ready, parameterized paginated reports using the Get Data experience in Power BI Report Builder—accessing over 100 data sources.

Learn more about all of the Power BI announcements in the Power BI September 2024 Feature blog. 

Start building your Fabric skills

We are grateful so many of you have decided to grow your skills with Microsoft Fabric. In the past six months alone, more than 17,000 individuals have earned the Fabric Analytics Engineer Associate certification, making it the fastest growing certification in Microsoft’s history. Today, we’re excited to announce a brand-new certification for data engineers coming in late October. The new Microsoft Certified: Fabric Data Engineer Associate certification will help you prove your skills with data ingestion, transformation, administration, monitoring, and performance optimization in Fabric. 

Our portfolio of Microsoft Credentials for Fabric also includes four Microsoft Applied Skills, which are a complement to Microsoft certifications and free of cost. Applied Skills test your ability to complete a real-world scenario in a lab environment and provide you with formal credentials that showcase your technical skills to employers. For Fabric, we have Applied Skills credentials covering implementing lakehouses, data warehouses, data science and real-time intelligence solutions. 

Visit the Fabric Career Hub to get the best free resources to help you get certified and the latest certification exam discounts. Don’t forget to also join the vibrant Fabric community to connect with like-minded data professionals, get all your Fabric technical questions answered, and stay current on the latest product updates, training programs, events, and more. 

And if you want to test your skills, explore Fabric, and win prizes, you can also register for the Microsoft Fabric and AI Learning Hackathon. To learn more, you can join our Ask Me Anything event on October 8. 

Join us at Microsoft Ignite

We are excited to bring even more innovation to the Microsoft Fabric platform at Microsoft Ignite this year. Join us from November 19 through November 21, 2024 either in person in Chicago or online. You will see firsthand the latest solutions and capabilities across all of Microsoft and connect with experts, community leaders, and partners who can help you modernize and manage your own intelligent apps, safeguard your business and data, accelerate productivity, and so much more. 

Explore additional resources for Microsoft Fabric

If you want to learn more about Microsoft Fabric: 

• Sign up for the Microsoft Fabric free trial.
• Register for the upcoming Microsoft Data and Analytics Forum. 
• View the updated Microsoft Fabric Roadmap.
• Visit the Microsoft Fabric website.
• Join the Fabric community.
• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog.
• Read additional blogs by industry-leading partners: 
  • Plug and play Databricks Unity Catalog in the Microsoft Fabric data platform and Why Microsoft Fabric is critical for AI-driven enterprises, by Sonata Software, a leading Modernization Engineering company. 
  • Citizen developers can scale work with IT pros like never before with Microsoft Fabric, by iLink Digital, a global provider of next-generation digital transformative solutions. 
  • Significance of version history for Direct Lake semantic models, by Softcrylic, now part of Hexaware Technologies, a global technology and business process services company.  
• Explore the Fabric technical documentation.

The post European Fabric Community Conference 2024: Building an AI-powered data platform appeared first on Microsoft Fabric Blog.

With Microsoft Fabric, we are simplifying and future-proofing your data estate with an ever-evolving, AI-powered data analytics platform. Fabric will keep up with the trends for you and seamlessly integrate each new capability so you can spend less time integrating and managing your data estate and more time unlocking value from your data.  

Get started with Microsoft Fabric

Set up Fabric for your business and discover resources that help you take the first steps

Try for free

Aurizon, Australia’s largest rail freight operator, turned to Fabric to modernize their data estate and analytics system.

“With Microsoft Fabric, we’ve answered many of our questions about navigating future growth, to remove legacy systems, and to streamline and simplify our architecture. A trusted data platform sets us up to undertake complex predictive analytics and optimizations that will give greater surety for our business and drive commercial benefits for Aurizon and our customers in the very near future.”

—Tammy Wigg, Chief Data Analytics Officer at Aurizon

Aurizon is just one among thousands of customers who have already used Fabric to revolutionize how they connect to and analyze their data. In fact, a 2024 commissioned Total Economic Impact™ (TEI) study conducted by Forrester Consulting found that Microsoft Fabric customers saw a three-year 379% return on investment (ROI) with a payback period of less than six months. We are thrilled to share a huge range of new capabilities coming to Fabric. These innovations will help you more effectively uncover insights and keep you at the forefront of the trends in data and analytics. Check out a quick overview of the biggest changes coming to Fabric.

Fabric is a complete data platform

Fabric is a complete data platform—giving your data teams the ability to unify, transform, analyze, and unlock value from data from a single, integrated software as a service (SaaS) experience. We are excited to announce additions to the Fabric workloads that will make Fabric’s capabilities even more robust and even customizable to meet the unique needs of each organization. These enhancements include: 

1. A completely redesigned workload, Real-Time Intelligence, that brings together and enhances Synapse Real-Time Analytics and Data Activator to help you analyze and act on high-volume, high-granular event streaming data and even explore your organization’s real-time data in the new Real-time hub.

2. New tools like the Fabric Workload Development Kit, Application Programming Interface (API) for GraphQL™, and “user data functions” that can help developers build powerful solutions on the Fabric platform. 

3. A new feature in the Microsoft Azure Data Factory experience called Data workflow, powered by Apache Airflow runtime, that can help you author, schedule, and monitor workflows or data pipelines using Python. 

Unlock continuous insights with Real-Time Intelligence and the Real-time hub

When we introduced Fabric, it launched with seven core workloads which included Synapse Real-time Analytics for data streaming analysis and Data Activator for monitoring and triggering actions in real-time. We are unveiling an enhanced workload called Real-Time Intelligence that combines these workloads and brings an array of additional new features, in preview, to help organizations make better decisions with up-to-the-minute insights. From ingestion to transformation, querying, and taking immediate action, Real-Time Intelligence is an end-to-end experience that enables seamless handling of real-time data without the need to land it first. With Real-Time Intelligence, you can ingest streaming data with high granularity, dynamically transform streaming data, query data in real-time for instant insights, and trigger actions like alerting a production manager when equipment is overheating or rerunning jobs when data pipelines fail. And with both simple, low-code or no-code, and powerful, code-rich interfaces, Real-Time Intelligence empowers every user to work with real-time data. 

Behind this powerful workload is the Real-time hub, a single place to discover, manage, and use event streaming data from Fabric and other data sources from Microsoft, third-party cloud providers, and other external data sources. Just like the OneLake data hub makes it easy to discover, manage, and use the data at rest, the Real-time hub can help you do the same for data in motion. All events that flow through the Real-time hub can be easily transformed and routed to any Fabric data store and users can create new streams that can be discovered and consumed. From the Real-time hub, users can gain insights through the data profile, configure the right level of endorsement, set alerts on changing conditions and more, all without leaving the hub. While the existing Real-Time Analytics capabilities are still generally available, the Real-time hub and the other new capabilities coming to the Real-Time Intelligence workload are currently in preview. Watch this demo video to check out the redesigned Real-Time Intelligence experience:  

Elcome, one of the world’s largest marine electronics companies, built a new service on Fabric called “Welcome” that helps maritime crews stay connected to their families and friends.

Microsoft Fabric Real-Time Intelligence has been the essential building block that’s enabled us to monitor, manage, and enhance the services we provide. With the help of the Real-time hub for centrally managing data in motion from our diverse sources and Data Activator for event-based triggers, Fabric’s end-to-end cloud solution has empowered us to easily understand and act on high-volume, high-granularity events in real-time with fewer resources.”

—Jimmy Grewal, Managing Director of Elcome

Real-time insights are becoming increasingly critical across industries like route optimization in transportation and logistics, grid monitoring in energy and utilities, predictive maintenance in manufacturing, and inventory management in retail. And since Real-Time Intelligence comes fully optimized and integrated in a SaaS platform, adoption is seamless. Strathan Campbell, Channel Environment Technology Lead at One NZ—the largest mobile carrier in New Zealand—said they “…went from a concept to a delivered product in just two weeks.” To learn more about the Real-Time Intelligence workload, watch the “Ingest, analyze and act in real time with Microsoft Fabric” Microsoft Build session or read the Real-Time Intelligence blog.  

Extend Fabric with your own, custom workloads and experiences

Fabric was built from the ground up to be extensible, customizable, and open. Now, we are making it even easier for software developers and customers to design, build, and interoperate applications within Fabric with the new Fabric Workload Development Kit—currently in preview. Applications built with this kit will appear as a native workload within Fabric, providing a consistent experience for users directly in their Fabric environment without any manual effort. Software developers can publish and monetize their custom workloads through Azure Marketplace. And, coming soon, we are creating a workload hub experience in Fabric where users can discover, add, and manage these workloads without ever leaving the Fabric environment. We already have industry-leading partners building on Fabric including SAS, Esri, Informatica, Teradata, and Neo4j.

You can also learn more about the Workload Development Kit by watching the “Extend and enhance your analytics applications with Microsoft Fabric” Microsoft Build session.

We are also excited to announce two new features, both in preview, created with developers in mind: API for GraphQL and user data functions in Fabric. API for GraphQL is a flexible and powerful RESTful API that allows data professionals to access data from multiple sources in Fabric with a single query API. With API for GraphQL, you can streamline requests to reduce network overheads and accelerate response rates. User data functions are user-defined functions built for Fabric experiences across all data services, such as notebooks, pipelines, or event streams. These features enable developers to build experiences and applications using Fabric data sources more easily like lakehouses, data warehouses, mirrored databases, and more with native code ability, custom logic, and seamless integration. You can watch these features in action in the “Introducing API for GraphQL and User Data Functions in Microsoft Fabric” Microsoft Build session.

You can also learn more about the Workload Development Kit, the API for GraphQL, user data functions, and more by reading the Integrating ISV apps with Microsoft Fabric blog.

Orchestrate complex data workflows in the Fabric Data Factory workload

We are also announcing the preview of Data workflows in Fabric as part of the Data Factory experience. Data workflows allow customers to define Directed Acyclic Graphs (DAG) files for complex data workflow orchestration in Fabric. Data workflows is powered by the Apache Airflow runtime and designed to help you author, schedule and monitor workflows or data pipelines using python. Learn more by reading the data workflows blog.  

Fabric is lake-centric and open

The typical data estate has grown organically over time to span multiple clouds, accounts, databases, domains, and engines with a multitude of vendors and specialized services. OneLake, Fabric’s unified, multi-cloud data lake built to span an entire organization, can connect to data from across your data estate and reduce data duplication and sprawl.  

We are excited to announce the expansion of OneLake shortcuts to connect to data from on-premises and network-restricted data sources beyond just Azure Data Lake Service Gen2, now in preview. With an on-premises data gateway, you can now create shortcuts to Google Cloud Storage, Amazon S3, and S3 compatible storage buckets that are either on-premises or otherwise network-restricted. To learn more about these announcements, watch the Microsoft Build session “Unify your data with OneLake and Microsoft Fabric.”  

Empower business users with Fabric

Insights drive impact only when they reach those who can use them to inform actions and decisions. Professional and citizen analysts bridge the gap between data and business results, and with Fabric, they have the tools to quickly manage, analyze, visualize, and uncover insights that can be shared with the entire organization. We are excited to help analysts work even faster and more effectively by releasing the model explorer and the DAX query view in Microsoft Power BI Desktop into general availability.

The model explorer in Microsoft Power BI provides a rich view of all the semantic model objects in the data pane—helping you find items in your data fast. You can also use the model explorer to create calculation groups and reduce the number of measures by reusing calculation logic and simplifying semantic model consumption. 

The DAX query view in Power BI Desktop lets users discover, analyze, and see the data in their semantic model using the DAX query language. Users working with a model can validate data and measures without having to build a visual or use an additional tool—similar to the Explore feature. Changes made to measures can be seamlessly updated directly back to the semantic model. 

To learn more about these announcements and others coming to Power BI, check out the Power BI blog.  

Fabric is AI-powered

When ChatGPT was launched, it had over 100 million users in just over two months—the steepest adoption curve in the history of technology.¹ It’s been a year and a half since that launch, and organizations are still trying to translate the benefit of generative AI from novelty to actual business results. By infusing generative AI into every layer of Fabric, we can empower your data professionals to employ its benefits, in the right context and in the right scenario to get more done, faster.  

Use Copilot in Fabric, now generally available 

Copilot in Fabric was designed to help users unlock the full potential of their data by assisting data professionals to be more productive and business users to explore their data more easily. With Copilot in Fabric, you can use conversational language to create dataflows, generate code and entire functions, build machine learning models, or visualize results. We are excited to share that Copilot in Fabric is now generally available, starting with the Power BI experience. This includes the ability to create stunning reports and summarize your insights into narrative summaries in seconds. Copilot in Fabric is also now enabled on-by-default for all eligible tenants including Copilot in Fabric experiences for Data Factory, Data Engineering, Data Science, Data Warehouse, and Real-Time Intelligence, which are all still in preview. The general availability of Copilot in Fabric for the Power BI experience will be rolling out over the coming weeks to all customers with Power BI Premium capacity (P1 or higher) or Fabric capacity (F64 or higher). 

We are also thrilled to announce a new Copilot in Fabric experience for Real-Time Intelligence, currently in preview, that enables users to explore real-time data with ease. Starting with a Kusto Query Language (KQL) Queryset connected to a KQL Database in an Eventhouse or a standalone Azure Data Explorer database, you can type your question in conversational language and Copilot will automatically translate it to a KQL query you can execute. This experience is especially powerful for users less familiar with writing KQL queries but still want to get the most from their time-series data stored in Eventhouse. 

Create custom Q&A experiences with your data with AI skills 

We are also thrilled to release a new AI capability in preview called AI skills—an innovative experience designed to provide any user with a conversational Q&A experience about their data. AI skills allow you to simply select the data source in Fabric you want to explore and immediately start asking questions about your data—even without any configuration. When answering questions, the generative AI experience will show the query it generated to find the answer and you can enhance the Q&A experience by adding more tables, setting additional context, and configuring settings. AI skills can empower everyone to explore data, build and configure AI experiences, and get the answers and insights they need.  

AI skills will honor existing security permissions and can be configured to respect the unique language and nuances of your organization, ensuring that responses are not just data-driven but steeped in the context of your business operations. And, coming soon, it can also enrich the creation of new copilots in Microsoft Copilot Studio and be interacted with from Copilot for Microsoft for 365. It’s about making your data not just accessible but approachable, inviting users to explore insights through natural dialogue, and shortening the time to insight.

New partnerships with Microsoft Fabric

Snowflake and Microsoft Fabric

With the launch of Fabric, we’ve committed to open data formats, standards, and interoperability with our partners to give our customers the flexibility to do what makes sense for their business. We are taking this commitment a step further by expanding our existing partnership with Snowflake to expand interoperability between Snowflake and Fabric’s OneLake. We are excited to announce future support for Apache Iceberg in Fabric OneLake and bi-directional data access between Snowflake and Fabric. This integration will enable users to analyze their Fabric and Snowflake data written in Iceberg format in any engine within either platform, and access data across apps like Microsoft 365, Microsoft Power Platform, and Microsoft Azure AI Studio.

With the upcoming availability of shortcuts for Iceberg in OneLake, Fabric users will be able to access all data sources in Iceberg format, including the Iceberg sources from Snowflake, and translate metadata between Iceberg and Delta formats. This means you can work with a single copy of your data across Snowflake and Fabric. Since all the OneLake data can be accessed in Snowflake as well as in Fabric, this integration will enable you to spend less time stitching together applications and your data estate, and more time uncovering insights. To learn more about this announcement, read the Fabric and Snowflake partnership blog.

Adobe and Microsoft Fabric 

We are also excited to announce we are expanding our existing relationship with Adobe. Adobe Experience Platform (AEP) and Adobe Campaign will have the ability to federate enterprise data from Fabric. Our joint customers will soon have the capability to connect to Fabric and use the Fabric Data Warehouse for query federation to create and enrich audiences for engagement, without having to transfer or extract the data from Fabric. 

Combine Fabric and Microsoft Azure Databricks to get the best of both worlds

We are excited to announce that we are expanding the integration between Fabric and Azure Databricks—allowing you to have a truly unified experience across both products and pick the right tools for any scenario. 

Azure Databricks Unity Catalog integration with Fabric 

Coming soon, you will be able to access Azure Databricks Unity Catalog tables directly in Fabric, making it even easier to unify Azure Databricks with Fabric. From the Fabric portal, you can create and configure a new Azure Databricks Unity Catalog item in Fabric with just a few clicks. You can add a full catalog, a schema, or even individual tables to link and the management of this Azure Databricks item in OneLake—a shortcut connected to Unity Catalog—is automatically taken care of for you.  

This data acts like any other data in OneLake—you can write SQL queries or use it with any other workloads in Fabric including Power BI through Direct Lake mode. When the data is modified or tables are added, removed, or renamed in Azure Databricks, the data in Fabric will remain always in sync. This new integration makes it simple to unify Azure Databricks data in Fabric and seamlessly use it across every Fabric workload. 

Federate OneLake as a Remote Catalog in Azure Databricks 

Also coming soon, Fabric users will be able to access Fabric data items like lakehouses as a catalog in Azure Databricks. While the data remains in OneLake, you can access and view data lineage and other metadata in Azure Databricks and leverage the full power of Unity Catalog. This includes extending Unity Catalog’s unified governance over data and AI into Azure Databricks Mosaic AI. In total, you will be able to combine this data with other native and federated data in Azure Databricks, perform analysis assisted by generative AI, and publish the aggregated data back to Power BI—making this integration complete across the entire data and AI lifecycle. 

Watch these announcements in action at Microsoft Build 2024

Join us at Microsoft Build from May 21 to 23, 2024 to see all of these announcements in action across the following sessions: 

• “Microsoft Build opening keynote” with Satya Nadella, Kevin Scott, and Rajesh Jha.

• “Next generation AI for developers with the Microsoft Cloud” with Scott Guthrie.

• “Microsoft Fabric: What’s new and what’s next” with Arun Ulagaratchagan and Amir Netz.

• “Ingest, analyze and act in real time with Microsoft Fabric” with Yitzhak Kesselman and Tessa Kloster.

• “Extend and enhance your analytics applications with Microsoft Fabric” with Dipti Borkar and Teddy Bercovitz.

• Introducing API for GraphQL and User Data Functions in Microsoft Fabric” with Monica Boris and Dipti Borkar.

• “Unify your data with OneLake and Microsoft Fabric” with Josh Caplan and Charles Webb.

• “Accelerate insights with real-time Azure SQL Data and Microsoft Fabric” with Anna Hoffman and Bob Ward.
• “Intergrating Azure AI and Microsoft Fabric for Next-Gen AI Solutions” with Nellie Gustafsson and Facundo Santiago.
• “Activate enterprise data in AI-enabled business applications” with Rakesh Krishnan and Srikumar Nair.

You can also try out these new capabilities and everything Fabric has to offer yourself by signing up for a free 60-day trial—no credit card information required. To start your free trial, sign up for a free account (Power BI customers can use their existing account), and once signed in, select start trial within the account manager tool in the Fabric app. Existing Power BI Premium customers can already access Fabric by simply turning on Fabric in their Fabric admin portal. Learn more on the Fabric get started page. 

Join us at the European Microsoft Fabric Community Conference 

We are excited to announce a European Microsoft Fabric Community Conference that will be held in Stockholm, Sweden from September 23 to 26, 2024. You can see firsthand how Fabric and the rest of the data and AI products at Microsoft can help your organization prepare for the era of AI. You will hear from leading Microsoft and community experts from around the world and get hands on experiences with the latest features from Fabric, Power BI, Azure Databases, Azure AI, Microsoft Purview, and more. You will also have the opportunity to learn from top data experts and AI leaders while having the chance to interact with your peers and share your story. We hope you will join us and see how cutting-edge technologies from Microsoft can enable your business success with the power of Fabric.   

Explore additional resources for Microsoft Fabric

If you want to learn more about Microsoft Fabric: 

• Sign up for the Microsoft Fabric free trial.
• View the updated Microsoft Fabric Roadmap.
• Visit the Microsoft Fabric website.
• Join the Fabric community.
• Read about other Azure announcements:  

• • From code to production: New ways Azure helps your build transformational AI experiences.

• • Unleashing innovation: The new era of compute powering Azure AI solutions.

• Read other in-depth, technical blogs on the Microsoft Fabric Updates Blog.
• Read the new Microsoft Fabric security whitepaper.
• Watch the Real-Time Intelligence Microsoft Mechanics video.
• Explore the Fabric technical documentation.

Microsoft Fabric

Experience the next generation in analytics 

Explore capabilities

¹ChatGPT sets record for fastest-growing user base – analyst note, Reuters.

The post Unlock real-time insights with AI-powered analytics in Microsoft Fabric appeared first on Microsoft Fabric Blog.