{"id":34730,"date":"2021-04-07T08:00:06","date_gmt":"2021-04-07T15:00:06","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?p=34730"},"modified":"2021-03-29T09:06:14","modified_gmt":"2021-03-29T16:06:14","slug":"whats-new-with-sql-server-big-data-clusters-cu10-release","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/","title":{"rendered":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release"},"content":{"rendered":"<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/big-data-cluster\/big-data-cluster-overview?view=sql-server-ver15\" target=\"_blank\" rel=\"noopener\">SQL Server Big Data Clusters<\/a>\u00a0 is a new capability brought to market as part of the SQL Server 2019 release. Big Data Clusters extends SQL Server\u2019s analytical capabilities beyond in-database processing of transactional and analytical workloads by uniting the SQL engine with Apache Spark and Apache Hadoop to create a single, secure, and unified data platform.<\/p>\n<p>Big Data Clusters is available exclusively to run on Linux containers, orchestrated by Kubernetes, and can be deployed in multiple-cloud providers or on-premises.<\/p>\n<p>Today, we\u2019re announcing the release of the latest cumulative update (CU), CU10, for SQL Server Big Data Clusters, which includes important capabilities:<\/p>\n<ul>\n<li>Upgraded base images from Ubuntu 16.04 to Ubuntu 20.04.<\/li>\n<li>High availability support for Hadoop KMS components.<\/li>\n<li>Additional configurability of SQL Server networking and process affinity settings <span class=\"TrackChangeTextInsertion TrackedChange SCXW85138829 BCX0\"><span class=\"TextRun SCXW85138829 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW85138829 BCX0\">at the resource-<\/span><\/span><\/span><span class=\"TrackChangeTextInsertion TrackedChange SCXW85138829 BCX0\"><span class=\"TextRun SCXW85138829 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW85138829 BCX0\">scope.<\/span><\/span><\/span><\/li>\n<li><span class=\"TrackChangeTextInsertion TrackedChange SCXW205381019 BCX0\"><span class=\"TextRun SCXW205381019 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun CommentStart SCXW205381019 BCX0\">Resource management for Spark-relat<\/span><\/span><\/span><span class=\"TrackChangeTextInsertion TrackedChange SCXW205381019 BCX0\"><span class=\"TextRun SCXW205381019 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW205381019 BCX0\">ed containers through cluster-scoped\u00a0<\/span><\/span><\/span><span class=\"TrackChangeTextInsertion TrackedChange SCXW205381019 BCX0\"><span class=\"TextRun SCXW205381019 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW205381019 BCX0\">settings.<\/span><\/span><\/span><\/li>\n<\/ul>\n<p>Major improvements in this update are highlighted below, along with resources for you to learn more and get started.<\/p>\n<h2>Upgraded base image versions<\/h2>\n<p>SQL Server 2019 CU9 included a software refresh for most of the open source components deployed with Big Data Clusters. Building on this momentum and in line with our commitment to ensure that Big Data Clusters component versions are up to date with those supported, we are now upgrading the base operating system (OS) for all container images from Ubuntu 16.04 to Ubuntu 20.04.<\/p>\n<p>For existing Big Data Clusters deployments, no other action is necessary apart from the <a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/big-data-cluster\/deployment-upgrade?view=sql-server-ver15\" target=\"_blank\" rel=\"noopener\">regular in-place upgrade to the new CU<\/a>. The new CU10 images that include the upgraded base OS version will be used when upgrading Big Data Clusters. As a best practice, we recommend upgrading to CU10 to take advantage of new capabilities and improvements and to ensure containers are covered by the Ubuntu support lifecycle.<\/p>\n<h2><span class=\"TrackChangeTextInsertion TrackedChange SCXW78412211 BCX0\"><span class=\"TextRun SCXW78412211 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun CommentStart SCXW78412211 BCX0\" data-ccp-parastyle=\"heading 2\">High Availability support for Hadoop KMS c<\/span><\/span><\/span><span class=\"TrackChangeTextInsertion TrackedChange SCXW78412211 BCX0\"><span class=\"TextRun SCXW78412211 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW78412211 BCX0\" data-ccp-parastyle=\"heading 2\">omponents<\/span><\/span><\/span><\/h2>\n<p>Consistent with our commitment to continuous improvements of the Encryption at Rest feature set, CU10 adds High Availability capabilities for Hadoops key management service (KMS) components. After the upgrade, all namenode pods will have a KMS instead of just one namenode pod. The benefits are two-fold, increased high availability and increased performance of encryption operations on encryption zones.<\/p>\n<h2>Ready to learn more?<\/h2>\n<p>Check out the SQL Server Big Data Clusters CU10 <a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/big-data-cluster\/release-notes-big-data-cluster?view=sql-server-ver15\" target=\"_blank\" rel=\"noopener\">release notes<\/a> to learn more about all the improvements available with the latest update. For a technical deep-dive on Big Data Clusters, take a look at the <a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/big-data-cluster\/big-data-cluster-overview?view=sql-server-ver15\" target=\"_blank\" rel=\"noopener\">documentation page<\/a> and visit our <a href=\"https:\/\/github.com\/microsoft\/sql-server-samples\/tree\/master\/samples\/features\/sql-big-data-cluster\" target=\"_blank\" rel=\"noopener\">GitHub repository<\/a>.<\/p>\n<p>Follow the instructions on our <a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/big-data-cluster\/big-data-cluster-overview?view=sql-server-ver15\" target=\"_blank\" rel=\"noopener\">documentation page<\/a> to get started and deploy Big Data Clusters.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>SQL Server Big Data Clusters is a new capability brought to market as part of the SQL Server 2019 release.<\/p>\n","protected":false},"author":6051,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"post_tag":[],"product":[],"content-type":[2421],"topic":[2451],"coauthors":[3593],"class_list":["post-34730","post","type-post","status-publish","format-standard","hentry","content-type-announcements","topic-big-data","review-flag-new-1593580247-437"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog\" \/>\n<meta property=\"og:description\" content=\"SQL Server Big Data Clusters is a new capability brought to market as part of the SQL Server 2019 release.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft SQL Server Blog\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/sqlserver\" \/>\n<meta property=\"article:published_time\" content=\"2021-04-07T15:00:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-03-29T16:06:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2018\/08\/cropped-microsoft_logo_element.png\" \/>\n\t<meta property=\"og:image:width\" content=\"512\" \/>\n\t<meta property=\"og:image:height\" content=\"512\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Rahul Ajmera\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:site\" content=\"@SQLServer\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Rahul Ajmera\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 min read\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\"},\"author\":[{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/rahul-ajmera\/\",\"@type\":\"Person\",\"@name\":\"Rahul Ajmera\"}],\"headline\":\"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release\",\"datePublished\":\"2021-04-07T15:00:06+00:00\",\"dateModified\":\"2021-03-29T16:06:14+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\"},\"wordCount\":430,\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\",\"name\":\"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\"},\"datePublished\":\"2021-04-07T15:00:06+00:00\",\"dateModified\":\"2021-03-29T16:06:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"name\":\"Microsoft SQL Server Blog\",\"description\":\"Official News from Microsoft\u2019s Information Platform\",\"publisher\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization\",\"name\":\"Microsoft SQL Server Blog\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"contentUrl\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png\",\"width\":259,\"height\":194,\"caption\":\"Microsoft SQL Server Blog\"},\"image\":{\"@id\":\"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"http:\/\/www.facebook.com\/sqlserver\",\"https:\/\/x.com\/SQLServer\",\"https:\/\/www.youtube.com\/user\/MSCloudOS\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/","og_locale":"en_US","og_type":"article","og_title":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog","og_description":"SQL Server Big Data Clusters is a new capability brought to market as part of the SQL Server 2019 release.","og_url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/","og_site_name":"Microsoft SQL Server Blog","article_publisher":"http:\/\/www.facebook.com\/sqlserver","article_published_time":"2021-04-07T15:00:06+00:00","article_modified_time":"2021-03-29T16:06:14+00:00","og_image":[{"width":512,"height":512,"url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2018\/08\/cropped-microsoft_logo_element.png","type":"image\/png"}],"author":"Rahul Ajmera","twitter_card":"summary_large_image","twitter_creator":"@SQLServer","twitter_site":"@SQLServer","twitter_misc":{"Written by":"Rahul Ajmera","Est. reading time":"2 min read"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#article","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/"},"author":[{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/author\/rahul-ajmera\/","@type":"Person","@name":"Rahul Ajmera"}],"headline":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release","datePublished":"2021-04-07T15:00:06+00:00","dateModified":"2021-03-29T16:06:14+00:00","mainEntityOfPage":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/"},"wordCount":430,"publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/","name":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release - Microsoft SQL Server Blog","isPartOf":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website"},"datePublished":"2021-04-07T15:00:06+00:00","dateModified":"2021-03-29T16:06:14+00:00","breadcrumb":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/2021\/04\/07\/whats-new-with-sql-server-big-data-clusters-cu10-release\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/"},{"@type":"ListItem","position":2,"name":"What\u2019s new with SQL Server Big Data Clusters\u2014CU10 release"}]},{"@type":"WebSite","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#website","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","name":"Microsoft SQL Server Blog","description":"Official News from Microsoft\u2019s Information Platform","publisher":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#organization","name":"Microsoft SQL Server Blog","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","contentUrl":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-content\/uploads\/2019\/08\/Microsoft-Logo.png","width":259,"height":194,"caption":"Microsoft SQL Server Blog"},"image":{"@id":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/#\/schema\/logo\/image\/"},"sameAs":["http:\/\/www.facebook.com\/sqlserver","https:\/\/x.com\/SQLServer","https:\/\/www.youtube.com\/user\/MSCloudOS"]}]}},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/34730"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/users\/6051"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/comments?post=34730"}],"version-history":[{"count":0,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/posts\/34730\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/media?parent=34730"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/post_tag?post=34730"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/product?post=34730"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/content-type?post=34730"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/topic?post=34730"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/sql-server\/blog\/wp-json\/wp\/v2\/coauthors?post=34730"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}