{"id":16027,"date":"2016-06-06T08:00:50","date_gmt":"2016-06-06T15:00:50","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/dataplatforminsider\/?p=16027"},"modified":"2024-01-22T22:50:30","modified_gmt":"2024-01-23T06:50:30","slug":"microsoft-announces-major-commitment-to-apache-spark","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/","title":{"rendered":"Microsoft announces major commitment to Apache Spark"},"content":{"rendered":"<p><em>This post was authored by Tiffany Wissner, Senior Director of Data Platform Marketing.<\/em><\/p>\n<p>This week in San Francisco, thousands of people are at <a href=\"https:\/\/spark-summit.org\/2016\/\">Spark Summit<\/a>, to explore and understand how they leverage <a href=\"https:\/\/spark.apache.org\/\">Apache Spark<\/a> to get the most out of big data. Building on <a href=\"https:\/\/blogs.technet.microsoft.com\/dataplatforminsider\/2015\/07\/10\/announcing-spark-for-azure-hdinsight-public-preview\/\">our previous investments<\/a>, today we are announcing an extensive commitment for Spark to power Microsoft\u2019s big data and analytics offerings including <a href=\"https:\/\/www.microsoft.com\/en-us\/server-cloud\/cortana-intelligence-suite\/overview.aspx\">Cortana Intelligence Suite<\/a>, <a href=\"https:\/\/powerbi.microsoft.com\/en-us\/\">Power BI<\/a>, and <a href=\"https:\/\/www.microsoft.com\/en-us\/server-cloud\/products\/r-server\/\">Microsoft R Server<\/a>:<\/p>\n<ul>\n<li>\n<b>Spark for Azure HDInsight General Availability<\/b>, <a href=\"https:\/\/blogs.technet.microsoft.com\/dataplatforminsider\/2015\/07\/10\/announcing-spark-for-azure-hdinsight-public-preview\/\">previously announced<\/a> as public preview, <a href=\"https:\/\/azure.microsoft.com\/en-us\/services\/hdinsight\/apache-spark\/\">Spark for Azure HDInsight<\/a> generally available today, and introducing a fully managed Spark service from Hortonworks that has been hardened for the enterprise and made simpler for you to use. You can also rely on the industry\u2019s highest availability service level agreement for Spark at 99.9%. You can get value out of Spark immediately with out-of-the-box integration with Jupyter, the most popular open source notebook for data scientists.<\/li>\n<li>\n<b>R Server for HDInsight in the cloud powered by Spark<\/b>, <a href=\"https:\/\/blogs.technet.microsoft.com\/machinelearning\/2016\/03\/29\/microsoft-makes-big-data-analytics-easier-in-the-cloud\/\">previously announced<\/a> as public preview, <a href=\"https:\/\/azure.microsoft.com\/en-us\/services\/hdinsight\/r-server\/\">R Server for HDInsight<\/a> will be generally available in the summer making the Spark integration available both on-premises and in the cloud. This makes it easy to move code and projects to the cloud with a few clicks and within a few minutes without buying hardware or hiring specialized operations teams typically associated with big data infrastructure.<\/li>\n<li>\n<b>R Server for Hadoop on-premises now powered by Spark<\/b>, as the leading solution in the world to run R at scale, <a href=\"https:\/\/www.microsoft.com\/en-us\/server-cloud\/products\/r-server\/\">R Server for Hadoop<\/a> will support both Microsoft R and native Spark execution frameworks available in June. Combining R Server with Spark gives users the ability to run R functions over thousands of Spark nodes letting you train your models on data 1000x larger and 100x faster than was possible with open source R and nearly 2x faster than Spark\u2019s own MLLib.<\/li>\n<li>\n<strong>Free R Client for Data Scientists<\/strong>, today we are announcing Microsoft R Client, a new freely available tool for data scientists to build high performance analytics using R.\u00a0 R Client not only allows you to use any of the open source R functions to analyze the data present on your local workstation, it also enables you to analyze remote big data and scale out the analytics by pushing the computation to a production instance of Microsoft R Server such as SQL Server R Services, R Server for Hadoop and HD Insight with Spark. You can download Microsoft R Client today at <a href=\"http:\/\/aka.ms\/rclient\" target=\"_blank\" rel=\"noopener\">http:\/\/aka.ms\/rclient<\/a>.<\/li>\n<li>\n<b>Power BI support for Spark Streaming, <\/b><a href=\"http:\/\/blogs.microsoft.com\/blog\/2015\/07\/10\/over-500000-unique-users-from-45000-companies-across-185-countries-helped-shape-the-new-power-bi\/#sm.00000yx7silgt6dw4z6uwljckjl18\">previously announced<\/a> with Power BI General Availability, Spark support in Power BI is now expanded with new support for Spark Streaming scenarios. This allows you to publish real-time events from Spark Streaming directly into one of the fastest growing visualization tools in the market today.<\/li>\n<\/ul>\n<p>It&#8217;s an exciting time for Spark users and for R users alike. We have much more to tell you and we\u2019ll look forward to seeing you this week at <a href=\"https:\/\/spark-summit.org\/2016\/\">Spark Summit in San Francisco<\/a> so come by our booth or join Joseph Sirosh, corporate vice president, Microsoft for his keynote on Wednesday, June 8 at 9:20 AM PT.<\/p>\n<p>It promises to be an exciting week! And if you\u2019re unable to join us in person you can get lots more information on today\u2019s announcement on our <a href=\"https:\/\/azure.microsoft.com\/en-us\/services\/hdinsight\/apache-spark\/\">apache-spark<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/server-cloud\/products\/r-server\/\">r-server<\/a> sites. Also come and visit us back at this blog where we\u2019ll be sharing additional insights on our news announcements.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This post was authored by Tiffany Wissner, Senior Director of Data Platform Marketing. This week in San Francisco, thousands of people are at Spark Summit, to explore and understand how they leverage Apache Spark to get the most out of big data.<\/p>\n","protected":false},"author":1457,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","footnotes":""},"post_tag":[],"product":[],"content-type":[2421,2448],"topic":[],"coauthors":[2487],"class_list":["post-16027","post","type-post","status-publish","format-standard","hentry","content-type-announcements","content-type-updates"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog\" \/>\n<meta property=\"og:description\" content=\"This post was authored by Tiffany Wissner, Senior Director of Data Platform Marketing. This week in San Francisco, thousands of people are at Spark Summit, to explore and understand how they leverage Apache Spark to get the most out of big data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft SQL Server Blog\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/sqlserver\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-06T15:00:50+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-23T06:50:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2018\/08\/cropped-microsoft_logo_element.png\" \/>\n\t<meta property=\"og:image:width\" content=\"512\" \/>\n\t<meta property=\"og:image:height\" content=\"512\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"SQL Server Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:site\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"SQL Server Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 min read\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\"},\"author\":[{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/sql-server-team\/\",\"@type\":\"Person\",\"@name\":\"SQL Server Team\"}],\"headline\":\"Microsoft announces major commitment to Apache Spark\",\"datePublished\":\"2016-06-06T15:00:50+00:00\",\"dateModified\":\"2024-01-23T06:50:30+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\"},\"wordCount\":584,\"commentCount\":3,\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\",\"name\":\"Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\"},\"datePublished\":\"2016-06-06T15:00:50+00:00\",\"dateModified\":\"2024-01-23T06:50:30+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Microsoft announces major commitment to Apache Spark\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"name\":\"Microsoft SQL Server Blog\",\"description\":\"Official News from Microsoft\u2019s Information Platform\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\",\"name\":\"Microsoft SQL Server Blog\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"width\":259,\"height\":194,\"caption\":\"Microsoft SQL Server Blog\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/www.facebook.com\/sqlserver\",\"https:\/\/x.com\/SQLServer\",\"https:\/\/www.youtube.com\/user\/MSCloudOS\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/","og_locale":"en_US","og_type":"article","og_title":"Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog","og_description":"This post was authored by Tiffany Wissner, Senior Director of Data Platform Marketing. This week in San Francisco, thousands of people are at Spark Summit, to explore and understand how they leverage Apache Spark to get the most out of big data.","og_url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/","og_site_name":"Microsoft SQL Server Blog","article_publisher":"http:\/\/www.facebook.com\/sqlserver","article_published_time":"2016-06-06T15:00:50+00:00","article_modified_time":"2024-01-23T06:50:30+00:00","og_image":[{"width":512,"height":512,"url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2018\/08\/cropped-microsoft_logo_element.png","type":"image\/png"}],"author":"SQL Server Team","twitter_card":"summary_large_image","twitter_creator":"@SQLServer","twitter_site":"@SQLServer","twitter_misc":{"Written by":"SQL Server Team","Est. reading time":"2 min read"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#article","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/"},"author":[{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/sql-server-team\/","@type":"Person","@name":"SQL Server Team"}],"headline":"Microsoft announces major commitment to Apache Spark","datePublished":"2016-06-06T15:00:50+00:00","dateModified":"2024-01-23T06:50:30+00:00","mainEntityOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/"},"wordCount":584,"commentCount":3,"publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/","name":"Microsoft announces major commitment to Apache Spark - Microsoft SQL Server Blog","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website"},"datePublished":"2016-06-06T15:00:50+00:00","dateModified":"2024-01-23T06:50:30+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2016\/06\/06\/microsoft-announces-major-commitment-to-apache-spark\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/"},{"@type":"ListItem","position":2,"name":"Microsoft announces major commitment to Apache Spark"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","name":"Microsoft SQL Server Blog","description":"Official News from Microsoft\u2019s Information Platform","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization","name":"Microsoft SQL Server Blog","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","width":259,"height":194,"caption":"Microsoft SQL Server Blog"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/sqlserver","https:\/\/x.com\/SQLServer","https:\/\/www.youtube.com\/user\/MSCloudOS"]}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/16027","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/users\/1457"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/comments?post=16027"}],"version-history":[{"count":0,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/16027\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/media?parent=16027"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/post_tag?post=16027"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/product?post=16027"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/content-type?post=16027"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/topic?post=16027"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/coauthors?post=16027"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}