{"id":389102,"date":"2017-06-08T09:00:03","date_gmt":"2017-06-08T16:00:03","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?p=389102"},"modified":"2017-06-12T13:54:42","modified_gmt":"2017-06-12T20:54:42","slug":"nsf-big-data-innovation-hubs-collaboration","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/nsf-big-data-innovation-hubs-collaboration\/","title":{"rendered":"NSF Big Data Innovation Hubs collaboration \u2014 looking back after one year"},"content":{"rendered":"

By Vani Mandava<\/a>, Director, Data Science<\/em><\/p>\n

Significant technical advancements in cloud computing have led to lower infrastructure costs, making possible big storage and big computing. Big data technology, though, requires cross-discipline research within and beyond non-computing domains. This is where domain experts collaborate with computing teams, industry, and government agencies to discover new insights that may fundamentally change the way we think about science. The Big Data Innovation Hubs initiative, launched by the National Science Foundation (NSF) in collaboration with the host institutions, presents one such bold opportunity to focus on vertical-specific, yet interdisciplinary, research.<\/p>\n

Microsoft Research entered a partnership with the Big Data Regional Innovation Hubs (opens in new tab)<\/span><\/a> in June 2016 to further unleash the power of cloud computing to accelerate discovery. A year later, we offer a retrospective overview of the initiative to highlight what has worked and some of the research domains that have benefited from the collaboration.<\/p>\n

Microsoft\u2019s commitment of $3 million in cloud computing credits<\/a> was initially designed to boost the NSF-supported Big Data Spokes and Planning projects. The commitment was recently extended to other projects nominated by the regional Big Data Hub executive directors. The following table lists the projects that received awards totaling about $600,000 in Azure credits during the initial year.<\/p>\n

Award recipients:<\/strong><\/p>\n\n\n\n\n\n\n\n\n\n\n\n
Project<\/strong><\/td>\nVertical<\/strong><\/td>\nPartner<\/strong><\/td>\nPI name<\/strong><\/td>\nInstitution<\/strong><\/td>\n<\/tr>\n
Cloud computing for neuroscience research<\/td>\nHealth<\/td>\nMidwest<\/td>\nFranco Pestilli, assistant professor<\/td>\nIndiana University<\/td>\n<\/tr>\n
SEADTrain: Cloud-based, hands-on environment for online data science training<\/td>\nEducation<\/td>\nMidwest<\/td>\nBeth Plale, director<\/td>\nIndiana University<\/td>\n<\/tr>\n
Cloud infrastructure for vision-based yield mapping<\/td>\nAgriculture<\/td>\nMidwest<\/td>\nVolkan Isler, associate professor<\/td>\nUniversity of Minnesota<\/td>\n<\/tr>\n
Comprehensive and large-scale analysis of 10,000 microbiomes to better understand human disease<\/td>\nHealth<\/td>\nNortheast<\/td>\nChirag Patel, assistant professor<\/td>\nHarvard Medical School<\/td>\n<\/tr>\n
Accelerating analytical workloads using GPU-CPU coprocessing<\/td>\n\n

 <\/p>\n

Data Sharing \/ Computer Science<\/td>\n

Northeast<\/td>\n\n

Sam Madden, professor<\/p>\n

Anil Shanbhag, PhD student<\/td>\n

Massachusetts Institute of Technology<\/td>\n<\/tr>\n
Crowdsourcing platform for generating gold standard labels for medical data<\/td>\nHealth<\/td>\nSouth<\/td>\nGari Clifford, professor<\/td>\nEmory University<\/td>\n<\/tr>\n
Proteogenomic applications of genetic variations<\/td>\nGenomics<\/td>\nWest<\/td>\nEric Deutsch, senior research scientist<\/td>\nInstitute for Systems Biology, Seattle<\/td>\n<\/tr>\n
Metroinsight: Smart cities as a system<\/td>\nSmart Cities<\/td>\nWest<\/td>\nBharathan Balaji, postdoctoral scholar<\/td>\nUniversity of California, Los Angeles<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 
\n\u201cThis partnership in big data and data science with Microsoft is bringing together the expertise from academia, leading-edge infrastructure and technologies from industry, and interesting datasets from the government sector to solve important problems,\u201d said Dr. Jim Kurose, Assistant Director of the National Science Foundation for Computer and Information Science and Engineering.\u00a0 \u201cMicrosoft\u2019s significant contribution of cloud resources to the Big Data Hubs and Spokes effort has provided a major boost to the various Spokes projects. We are delighted to have Microsoft as a continued partner in this endeavor, and look forward to working with them, and with all of our industry partners.\u201d<\/p>\n

Background<\/h2>\n

The Microsoft Azure for Research (opens in new tab)<\/span><\/a> program was launched in 2014 and has directly engaged researchers and funding agencies including driving more than 1,000+ Azure grants and training more than 2,500 researchers in 400 universities in more than 50 countries worldwide. Our partnership with the Big Data Hubs in the United States has empowered the executive directors of the hubs to award cloud credits to research proposals reviewed by NSF for Spoke or Planning grants, or toward hub-supported activities and projects with a need for cloud computing resources. In addition, due to the inherent design of hubs to foster cross-sector collaboration, Azure training workshops are helping reach data science communities beyond academic researchers. More than 200 data scientists from all four regional hubs in the United States participated in intensive day-long, hands-on training workshops to learn how to use Azure (opens in new tab)<\/span><\/a> in their research.<\/p>\n

\u201cThe Azure for Research training at UT-Austin was an intense boot camp for data scientists and gave us the introductory tools needed to start building machine learning systems. The opportunities to build on top of Azure\u2019s platform and use its cloud computing resources are invaluable,\u201d said Adam Klivans, associate professor in the computer science department of the University of Texas at Austin and member of the South Big Data Hub.<\/p>\n

\"NSF

Clockwise from lower left: Azure training workshops at University of Chicago (Oct. 2016), University of Texas at Austin (Oct. 2016) and Center for Urban Science and Progress, New York University (Apr. 2017).<\/p><\/div>\n

The Big Data Innovation Hubs are designed to encourage multiple stakeholders, including federal agencies, private industry, academia, state and local governments, nonprofits and foundations to advance and apply data science research and innovation to regional and national challenges. The cross-sector nature of the partnerships is lighting up several verticals that benefit from industry collaboration and technology access to cloud computing. Let\u2019s explore some of these initiatives in diverse verticals, from agriculture to health, to obtain a glimpse of how the Big Data Hub initiative brings together these usually siloed and independent stakeholders to do research on the cloud.<\/p>\n

Healthcare and Genomics<\/h2>\n

Eric Deutsch of the Institute for Systems Biology in Seattle and Andreas Prlic of the Research Collaboratory for Structural Bioinformatics (RCSB) Protein Data Bank (PDB) are co-primary investigators (PI) on a $100,000 planning grant from NSF to increase collaborations in proteogenomic applications of genetic variations. The project brings together experts from the genomic and protein structure communities to help combine genetic variant datasets with the goal of disease diagnosis through proteogenomic data. \u201cWe are grateful to Microsoft\u2019s support in our efforts to deploy proteogenomic software tools onto Azure, and to build a framework that enables researchers to transfer data among all these various community tools,\u201d said Deutsch. The team is using Azure through West Big Data Hub<\/strong> credits to run their Trans-Proteomic Pipeline (TPP) on containers in Azure and train (opens in new tab)<\/span><\/a> students on advanced analytics techniques for using TPP.<\/p>\n

\u201cUsing Azure, we expect to provide a scalable cloud-based system for aggregating conflicting diagnoses and medical labels, and integrate out the biases and errors inherent in medical decision support,\u201d said Gari Clifford of Emory University. Clifford and Herman Taylor, from Morehouse School of Medicine, are South Big Data Hub<\/strong> co-principal investigators on a $1 million NSF Spoke award that brings together six universities for a project designed to address the fractured nature of healthcare information. The project aims to devise a system that provides a highly efficient way to create ground-truth data that powers classifiers and diagnostic tools that comprise modern healthcare systems.<\/p>\n

Chirag Patel, assistant professor at Harvard Medical School, is lead PI for a $1 million Big Data Spoke award (opens in new tab)<\/span><\/a> for a project titled Comprehensive and Large-scale Analysis of Metagenomic Data to better understand Human Disease<\/strong>. The project is a great example of how the hubs bring together cross-sector collaborations – the project includes five federal agencies, four universities, and a major health system. \u201cWe are excited to leverage Azure data science virtual machines to create high throughput meta-analysis pipelines for modeling gene networks within microbial metagenomes. Separately we plan to host the exposomeDB in Azure and allow researchers to work with the data using the Jupyter notebook service,\u201d said Patel. His team is building tools that will integrate over multiple datasets simultaneously with the goal of determining microbiome (including uncultivable organisms and undiscovered genes) correlation to human disease.<\/p>\n

Precision Agriculture<\/h2>\n

The Midwest Big Data Hub <\/strong>is focused on agriculture and brings together experts in fields such as machine learning, precision agriculture, and phenotyping. \u201cAgriculture researchers working in the field are creating new phenotypes, which, when combined with machine learning and low-cost end-to-end solutions, will drive the next wave of disruption that will help feed the growing population of the world,\u201d said Ranveer Chandra from Microsoft Research, Redmond.<\/p>\n

Chandra would know \u2014 he and his global team spent the past few years building FarmBeats<\/a>, which aspires to combat the world\u2019s food supply shortage using computer vision and machine learning on cyber-physical systems consisting of sensors and UAVs in remote areas that communicate with Azure on the white space spectrum. The Agriculture-Food Energy Water (Ag-FEW) stakeholders at the \u201cMachine Learning: Farm-to-Table (opens in new tab)<\/span><\/a>\u201d workshop hosted by the Midwest Big Data Hub,<\/strong> in collaboration with the International Food Security Institute at Illinois, are expected to further this research through new collaborations with top Ag-FEW researchers in the Midwest.<\/p>\n

Transportation<\/h2>\n

The West Big Data Hub, in collaboration with the three other Big Data Hubs and industry partners, spearheaded a National Transportation Data Challenge (opens in new tab)<\/span><\/a>, with a kickoff event in Seattle on May 2-3. The kickoff was the first in a series of community problem-solving sessions, demos and hackathons that are being organized across the nation over six months. \u00a0Several teams across Microsoft contributed ideas on recent and ongoing work on transportation data science.<\/p>\n

Microsoft\u2019s engagement with the challenge builds on a foundation of prior work in public safety and metro data science. The challenge\u2019s launch event highlighted a collaboration between Microsoft\u2019s Community Technology Engagement Group in the Corporate, External and Legal Affairs (CELA) team and DataKind Vision Zero, the New York City Department of Transportation, Seattle Department of Transportation and the City of New Orleans\u2019 Office of Performance and Accountability. The project enabled an ecosystem that helped cities (opens in new tab)<\/span><\/a> assign limited resources to traffic safety issues where they are most needed. In addition, the community event noted how Microsoft Research has been actively collaborating with the City of Bellevue (opens in new tab)<\/span><\/a> and University of Washington on a project that combines video analytics with machine learning to make roads safer.<\/p>\n

Education<\/h2>\n

The Midwest Big Data Hub (MBDH) is actively pursuing community building around data science in the Midwest of the United States. Beth Plale, Professor, Indiana University, and team are working on project SEADTrain: Cloud-based Hands On Environment for On-line Data Science Training <\/strong>to prototype an Azure based cloud solution for data science hands-on training. SEADTrain allows instructors to publish datasets to Azure through the SEAD curation pipeline where the datasets pick up persistent IDs. Students then carry out their training modules in the Azure based cloud using real data hosted there, an approach to training that substantially lowers the burden to students who would otherwise be burdened by setting up an environment on their desktop, moving data, etc. The larger goal (post pilot) is to demonstrate the effectiveness of the solution, as applied to real world training, by connecting the hands-on training to MOOC style delivery using a MOOC module repository that is being developed in a separate initiative.<\/p>\n

Big data hub leadership<\/h2>\n

All the progress in the past year wouldn\u2019t have been possible without the effort of the executive directors at the helms of each of the hubs. They have worked tirelessly to bring together thousands of data scientists across sectors and disciplines through numerous events and outreach efforts.<\/p>\n

\"\"

From left to right: Fen Zhao<\/strong>, Program Coordinator, NSF; Lea Shanley<\/strong>, South Co-Executive Director, University of North Carolina at Chapel Hill; Melissa Cragin<\/strong>, Midwest Executive Director, University of Illinois at Urbana-Champaign; Rene Baston<\/strong>, Northeast Executive Director, Columbia University; Meredith Lee<\/strong>, West Executive Director, UC Berkeley, Renata Rawlings-Goss<\/strong>, South Co-Executive Director, Georgia Institute of Technology, Vani Mandava<\/strong>, Director, Data Science, Microsoft Research<\/p><\/div>\n

 <\/p>\n

\"\"

Regional hubs for data science innovation create a framework for collaborations among academia, industry, and government.<\/p><\/div>\n

Conclusion<\/h2>\n

It has been a productive year driving the agenda for cloud computing for data science research and impact with the Big Data Innovation Hubs. Microsoft is committed to the partnership with NSF and the hubs and will continue pushing the boundaries to achieve accelerated research outcomes using cloud-based infrastructure and big data services.<\/p>\n

\u201cThe potential impact of data science platforms to shape generations of research relies on the imagination of collaborators to come together and shape it,\u201d said Joseph Sirosh, corporate vice president of the Cloud AI platform at Microsoft. \u201cPublic-private partnerships that encourage a culture of data innovation to solve long-range applied problems, from healthcare to transportation, will be the bedrock of this impact. Our work with the Big Data Hubs, launched by the National Science Foundation in collaboration with universities, enables researchers across fields to achieve concrete data outcomes with Microsoft tools, and it creates a catalyst for the company to build data science tools useful to researchers working in numerous domains.\u201d<\/em><\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

By Vani Mandava, Director, Data Science Significant technical advancements in cloud computing have led to lower infrastructure costs, making possible big storage and big computing. Big data technology, though, requires cross-discipline research within and beyond non-computing domains. This is where domain experts collaborate with computing teams, industry, and government agencies to discover new insights that […]<\/p>\n","protected":false},"author":39507,"featured_media":389222,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194467,194453,194474,194478,194484],"tags":[],"research-area":[13556,13563,198583,13553],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-389102","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artifical-intelligence","category-data-science","category-data-visulalization","category-ecology-and-environment","category-medical-health-and-genomics","msr-research-area-artificial-intelligence","msr-research-area-data-platform-analytics","msr-research-area-ecology-environment","msr-research-area-medical-health-genomics","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199565],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[204065,204068],"related-groups":[],"related-projects":[239387],"related-events":[],"related-researchers":[],"msr_type":"Post","featured_image_thumbnail":"\"NSF","byline":"","formattedDate":"June 8, 2017","formattedExcerpt":"By Vani Mandava, Director, Data Science Significant technical advancements in cloud computing have led to lower infrastructure costs, making possible big storage and big computing. Big data technology, though, requires cross-discipline research within and beyond non-computing domains. This is where domain experts collaborate with computing…","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/389102","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/comments?post=389102"}],"version-history":[{"count":22,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/389102\/revisions"}],"predecessor-version":[{"id":390122,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/posts\/389102\/revisions\/390122"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/389222"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=389102"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/categories?post=389102"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/tags?post=389102"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=389102"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=389102"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=389102"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=389102"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=389102"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=389102"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=389102"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=389102"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}