{"id":9398,"date":"2024-09-03T09:00:41","date_gmt":"2024-09-03T16:00:41","guid":{"rendered":"https:\/\/www.microsoft.com\/insidetrack\/blog\/?p=9398"},"modified":"2024-10-28T14:06:15","modified_gmt":"2024-10-28T21:06:15","slug":"modernizing-enterprise-integration-services-at-microsoft-with-microsoft-azure","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/insidetrack\/blog\/modernizing-enterprise-integration-services-at-microsoft-with-microsoft-azure\/","title":{"rendered":"Modernizing enterprise integration services at Microsoft with Microsoft Azure"},"content":{"rendered":"
Our Platform Engineering team in Microsoft Digital Employee Experience (MDEE) wanted to improve the capabilities, performance, and resiliency of our on-premises integration platform. To do this, the team used Microsoft Azure Integration Services to build a cloud-based integration platform as a service (iPaaS) solution that increased data-transaction throughput and integration capabilities for our enterprise data footprint and improved platform reliability.<\/p>\n
Business-to-business (B2B) and app-to-app (A2A) integration are imperatives in modern software solutions. Integration services use middleware technology that helps secure communication between integration points and data exchange between diverse enterprises and business applications. At Microsoft, our business demands integration across multiple independent software systems with diverse message formats such as EDIFACT, X12, XML, JSON, and flat file. Modern integration requires many modes of connectivity and data exchange, and includes the ability to connect:<\/p>\n
[Discover streamlining vendor assessment with ServiceNow VRM at Microsoft.<\/em><\/a> Explore shining a light on how Microsoft manages Shadow IT.<\/em><\/a> Unpack implementing a Zero Trust security model at Microsoft.<\/em><\/a>]<\/p>\n For decades, we as a company have worked to integrate our business data internally and in business-to-business scenarios with partners, vendors, and suppliers. BizTalk Server has been a standard for integration services for us and our partners, providing a foundation for dependable, easy-to-configure data integration.<\/p>\n Our ongoing digital transformation is driving cloud adoption to move business resources out of datacenters. As data storage and application development has evolved, cloud-native solutions based on SaaS and PaaS models have predominated among enterprise applications in most industries. To meet the growing need to supply increased scalability, reduce maintenance overhead for infrastructures, and decrease total cost of ownership, our Platform Engineering team has increasingly moved toward cloud-based solutions for enterprise integration.<\/p>\n Our Platform Engineering team began investigating Microsoft Azure Integration Services as a potential solution for scalable, cloud-based enterprise integration. Integration Services combines several Microsoft Azure services, including Logic Apps, API Management, Service Bus, Event Grid, and Azure Functions. These services provide a complete platform that companies can use to integrate business applications and data sources. Our team began working with Integration Services to gauge feasibility, test integration scenarios, and plan for enterprise-scale integration capabilities on the platform.<\/p>\n Throughout the development process, our Platform Engineering team worked closely with the Integration Services product group to enhance and build connectors. This collaboration allowed us to suggest improvements to existing Integration Services functionality. This effort prompted the creation of two new Logic Apps connectors\u2014SAP with Secure Network Communication (SNC) and Simple Mail Transport Protocol (SMTP)\u2014and enhancements to two existing Logic Apps connectors (EDIFACT and X12).<\/p>\n We in MDEE use all Microsoft Azure Integration Services components in its architecture to support end-to-end integration. Each component supplies an important part of the larger solution, including:<\/p>\n We used Microsoft Azure Front Door as the entry point for all inbound traffic and helped secure endpoints by using Microsoft Azure Web Application Firewall configured with assignment permissions for allowed IP addresses. Additionally, API Management enabled us to abstract the authentication layer from the processing pipeline to help increase security and simplify processing of incoming data.<\/p>\n We deployed the entire solution to an integration service environment, which supplied a fully isolated and dedicated integration environment and other benefits, including autoscaling, increased throughput limits, larger storage retention, improved availability, and a predictable cost model.<\/p>\n The following figure illustrates our solution’s architecture using Microsoft Azure Integration Services.<\/p>\n The solution architecture adheres to several important design principles and goals, including:<\/p>\n Our dataflow pipelines perform processing for most of our business-data transformation and movement tasks. We designed the B2B and A2A processing pipelines using Logic Apps and Microsoft Azure Functions, processing documents in their native format and delivering them to line of business (LOB) or enterprise resource planning (ERP) systems such as Finance, HR, Volume Licensing, Supply Chain, and SAP.<\/p>\n Our integration solution used these pipelines in practical business scenarios across many lines of business at Microsoft, such as for volume licensing. A hardware manufacturer that includes Windows or Microsoft Office in their laptops submits an order for Windows or Office license to Microsoft\u2019s ordering system, which sends the order details to our integration suite. The suite validates the messages, transforms them to IDoc format, and routes the IDoc to SAP using a data gateway for taxation and invoice generation. SAP generates an order acknowledgement in IDoc format and then passes it to the integration suite, which transforms the IDoc message into a format that the Microsoft ordering system will recognize.<\/p>\n Here’s another example from Microsoft Finance. An employee incurs an expense using a corporate credit card and the issuing financial institution sends a transaction report to the integration solution, which validates the message and performs currency conversion before sending it to Microsoft\u2019s expense-management system for further approvals. After it’s approved in the expense-management system, the remittance transaction flows through the integration suite back to the banking system for payment settlement.<\/p>\n We designed our solution to monitor message flow across the pipeline. Every transaction injects data into the telemetry pipeline using Microsoft Azure Event Hubs. The pipeline synthesizes and correlates that data to identify end-to-end processing status and recognize runtime failures. We built a custom tracking service that monitors and tracks important metrics for end-to-end workflows by using visual indicators on a dashboard. Accurate and readily available telemetry creates a more robust and reliable integration environment and improves the customer experience across pipelines.<\/p>\n We\u2019ve realized several benefits across our integration environment, including:<\/p>\n Microsoft Azure Integration Services has created an improved and more efficient integration environment for Microsoft. The increased scalability, reliability, and cost-effectiveness of Azure Integration Services has moved our business into a better position to actively collaborate with and operate alongside our partners, suppliers, and vendors. We\u2019re continuing to transform our integration services landscape with Azure Integration Services to keep pace with the rapidly changing modern business environment.<\/p>\n Our Platform Engineering team in Microsoft Digital Employee Experience (MDEE) wanted to improve the capabilities, performance, and resiliency of our on-premises integration platform. To do this, the team used Microsoft Azure Integration Services to build a cloud-based integration platform as a service (iPaaS) solution that increased data-transaction throughput and integration capabilities for our enterprise data […]<\/p>\n","protected":false},"author":133,"featured_media":9505,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_hide_featured_on_single":false,"_show_featured_caption_on_single":true,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[423],"coauthors":[646],"class_list":["post-9398","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-developer-tools","program-microsoft-digital-technical-stories","m-blog-post"],"yoast_head":"\nBuilding on a foundation of enterprise integration<\/h2>\n
Transforming integration with Microsoft Azure<\/h2>\n
Collaborating to improve Microsoft Azure Integration Services<\/h3>\n
Examining our Azure Integration Services architecture<\/h3>\n
\n
\n
Designing dataflow pipelines<\/h3>\n
\n
Capturing end-to-end messaging telemetry<\/h4>\n
<\/h2>\n
\n
<\/p>\n
\n