{"id":616008,"date":"2019-10-17T15:35:49","date_gmt":"2019-10-17T22:35:49","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=616008"},"modified":"2023-06-06T15:41:13","modified_gmt":"2023-06-06T22:41:13","slug":"leap","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/leap\/","title":{"rendered":"LEAP: Lean, Efficient, And Predictable Cloud Platforms"},"content":{"rendered":"<p>No public cloud can host large latency-sensitive services, such as search engines, in a way that is economic for those services today! Project <strong>LEAP<\/strong> (short for Lean, Efficient, And Predictable) addresses the research challenges in enabling cloud platforms to host these services in a rightsized, elastic, and with predictable tail latency.\u00a0 The challenges include how to prevent interference from co-located workloads, how to prevent performance jitter due to I\/O, how to make the services elastic despite their large storage footprints, and how to leverage spare capacity to run their batch workloads without affecting any co-located workloads.\u00a0 LEAP leverages emerging hardware and sophisticated software techniques to overcome these challenges.\u00a0 As a by-product of the project, we are also introducing an increasingly popular benchmark suite of representative Azure workloads.<\/p>\n<p>As a concrete target, we aim to host Bing head services on Azure with similar tail latency to their current latency on bare metal. We are pursuing this target in collaboration with several product groups, including Bing, Azure, and Windows\/Hyper-V.\u00a0 The benefits are significant, including new revenue for Azure as it will host latency-sensitive services for 1st and 3rd parties; new revenue for Bing as it will monetize its internal services, such as IndexServe, by providing them as Azure services to external users; and unifying AutoPilot and Azure into a single infrastructure.<\/p>\n<p>Another major concrete target is to deploy aggressive resource (CPU, memory, etc) oversubscription and harvesting in Azure without producing performance impact for workloads.\u00a0 This will produce substantially lower costs for Azure.<\/p>\n<p>Research challenges and our current progress:<\/p>\n<ul>\n<li>Reduce virtualization overhead (deployed in Bing and AZAP)<\/li>\n<li>Create accurate VM rightsizing algorithms (deployed in Azure)<\/li>\n<li>Eliminate cross-VM interference in last-level caches (SoCC&#8217;21)<\/li>\n<li>Eliminate performance jitter due to I\/O processing, without wasting resources (ASPLOS&#8217;20)<\/li>\n<li>Enable elasticity with high storage performance, despite large storage footprints<\/li>\n<li>Enable services to leverage burstable VMs and recommend their use (deployed in Azure)<\/li>\n<li>Harvest spare resources for workloads without affecting co-located VMs (OSDI&#8217;20, SOSP&#8217;21, EuroSys&#8217;21, ASPLOS&#8217;22, deployed in Azure)<\/li>\n<li>Maximize resource oversubscription without performance impact on workloads (paper in preparation, deployed in Azure)<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>No public cloud can host large latency-sensitive services, such as search engines, in a way that is economic for those services today! Project LEAP (short for Lean, Efficient, And Predictable) addresses the research challenges in enabling cloud platforms to host these services in a rightsized, elastic, and with predictable tail latency.\u00a0 The challenges include how [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"footnotes":""},"research-area":[13547],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-616008","msr-project","type-msr-project","status-publish","hentry","msr-research-area-systems-and-networking","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2017-09-01","related-publications":[632478,694536,737704,757489,780187,781513,807802],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Kapil Arya","user_id":37824,"people_section":"Section name 0","alias":"kaarya"},{"type":"user_nicename","display_name":"Ricardo Bianchini","user_id":33393,"people_section":"Section name 0","alias":"ricardob"},{"type":"user_nicename","display_name":"Sameh Elnikety","user_id":33503,"people_section":"Section name 0","alias":"samehe"},{"type":"user_nicename","display_name":"&Iacute;&ntilde;igo Goiri","user_id":32102,"people_section":"Section name 0","alias":"inigog"},{"type":"user_nicename","display_name":"Alok Kumbhare","user_id":36086,"people_section":"Section name 0","alias":"Alok Kumbhare"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/616008"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":17,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/616008\/revisions"}],"predecessor-version":[{"id":946203,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/616008\/revisions\/946203"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=616008"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=616008"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=616008"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=616008"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=616008"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}