{"id":4585,"date":"2019-05-02T17:37:21","date_gmt":"2019-05-03T00:37:21","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=4585"},"modified":"2023-07-20T09:57:09","modified_gmt":"2023-07-20T16:57:09","slug":"microsoft-internal-sap-workload-gets-a-telemetry-boost-with-azure","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/microsoft-internal-sap-workload-gets-a-telemetry-boost-with-azure\/","title":{"rendered":"Microsoft internal SAP workload gets a telemetry boost with Azure"},"content":{"rendered":"

\"MicrosoftFor the first time, Microsoft has end-to-end visibility into the millions of business processes that it runs through SAP every day.<\/p>\n

Microsoft is using a new suite of Microsoft Azure telemetry tools to gain insight into how to better manage expense reports, time away reporting, purchase order creation, and similar business processes that get routed through one of the largest SAP instances in the world. Before Microsoft moved its SAP workload into Azure and before it started using new Azure telemetry tools, there was no way to connect such transactions inside and outside of SAP.<\/p>\n

\u201cThis made the process feel like a black box to Microsoft employee users, and to our engineers, who needed to figure out what was happening so they could connect the dots and improve our services,\u201d says Enda Sullivan, a senior program manager for Microsoft Digital\u2019s internal SAP implementation.<\/p>\n

Because the SAP processes were not connected end-to-end, it was difficult to help Microsoft employees when something went wrong.<\/p>\n

\u201cIf there was a problem, it would require the user to engage with multiple teams, both SAP and non-SAP, to understand the status of a request,\u201d Sullivan says. \u201cBeyond that, the support teams often wouldn\u2019t have visibility to failed transactions between the various system steps. As a user, I should never have to call a helpdesk, the failure should be detected by the service telemetry and monitoring, and be resolved before I\u2019m even aware.\u201d<\/p>\n

Now through Azure, the team has real-time data that tells them when SAP process issues come up, which, importantly, allows them to get resolved before users realize something went wrong.<\/p>\n

Telemetry comes a long way<\/strong><\/p>\n

\"Cory
Cory Delamarter manages implementation of the Unified Telemetry Platform (UTP) at Microsoft. Delamarter is a principal program manager in Microsoft Digital. (Photo by Jim Adams | Inside Track)<\/figcaption><\/figure>\n

Historically, the use of telemetry to guide how companies like Microsoft use SAP was spotty at best, says Cory Delamarter, a principal program manager tasked with driving telemetry design and implementation standards across Microsoft Digital, which provides IT services for all of Microsoft.<\/p>\n

\u201cIt\u2019s great that Azure is giving us these new tools to work with, but this is something we were already starting to tackle,\u201d he says. \u201cThe opportunity and value of getting all our data in one place is too high to not solve this problem.\u201d<\/p>\n

Delamarter\u2019s team is working to bring a consistent approach to telemetry across all Microsoft Digital, an effort that has been tabbed the Unified Telemetry Platform (UTP).<\/p>\n

\u201cWhen we started to architect a new solution for telemetry, it needed to be scalable, reliable, and cost-effective, but most importantly a single common platform across the org,\u201d he says. “Essentially, we are consolidating tools and data stores.\u201d<\/p>\n

Standardization was a must, he says.<\/p>\n

\u201cWe had to design in flexibility that would support more than a system for monitoring a database or website,\u201d Delamarter says. \u201cThe power of unified telemetry is the ability to solve problems across boundaries, or service health, which supports the higher-level business processes.\u201d<\/p>\n

The companywide approach to telemetry is being built around Azure Monitor Application Insights, Azure Data Lake (Gen2) and Azure Data Explorer. \u201cApplication Insights provides the ability to ingest and organize incoming telemetry data, while Azure Data Explorer gives us the ability to aggregate and support queries across very large data sets stored in our data lake,\u201d he says.<\/p>\n

\"Graphic
The Unified Telemetry Platform (UTP) system ingests data from applications and infrastructure across the Microsoft internal environment. Data is transformed into a standard schema using Application Insights and housed in Azure Data Lake for cold storage. Azure Data Explorer provides the ability to query the datasets and build dashboards with Power BI in addition to Application Insights and Azure Monitor.<\/figcaption><\/figure>\n

Taking away the mystery<\/strong><\/p>\n

When it comes to getting more insights out of Microsoft\u2019s SAP workload, it really came down to taking the mystery away.<\/p>\n

\u201cFor SAP, we had to get out of the four walls and shine a light so it\u2019s no longer a black box,\u201d says Aron Stern, a senior software engineer inside Microsoft Digital who is responsible for the Azure architecture of the company\u2019s SAP infrastructure.<\/p>\n

First, the team needed to simplify everything.<\/p>\n

\u201cWe thought about the solution in two parts, telemetry, the raw metadata being emitted by our applications, then monitoring, reporting on service health through dashboards and alerting,\u201d Stern says. \u201cFrom there we separated the data into three layers\u2014infrastructure, application, and business process.\u201d<\/p>\n

Then the team needed to implement a bit of customization.<\/p>\n

\u201cWe built a small custom application using a few Azure tools,\u201d Stern says. \u201cThat allowed us to convert our application and business process telemetry events from SAP into common schema\u2014this allowed us to stitch our transactions together so we could get the end-to-end view we were looking for.\u201d<\/p>\n

The team then ingested all the SAP data into its Application Insights instance and fed that into an Azure Data Lake for cold storage and Power BI reporting.<\/p>\n

This new shift has enabled a powerful transformation, says Blake Barrow, a principal software engineer inside Microsoft Digital. \u201cBusiness process telemetry is what enables us to measure SLA\u2019s and provide transparency to our users,\u201d he says.<\/p>\n

Everyone who has access to this new telemetry are enjoying a whole wave of new insights.<\/p>\n

\u201cOur employee users now have better insight into any transaction they have on SAP,\u201d Barrow says. \u201cOur engineering teams are getting the data they need to detect issues before they can create downstream problems. Business executives have access to dashboards that provide near real-time status of transaction volumes, so they look for trends and do health checks on their programs.”<\/p>\n

All are changes that wouldn\u2019t be possible without transforming the way Microsoft approaches telemetry. \u201cThese are the kinds of improvements that can help us all have more impact,\u201d he says. \u201cThis is what digital transformation is all about.\u201d<\/p>\n

\"Related
\nBarrow, Stern, and Sullivan will be presenting how Microsoft is using UTP to gain insights on its SAP workload at the SAP SapphireNow Conference on Wednesday, May 8th.<\/p>\n