{"id":689037,"date":"2020-09-22T07:55:08","date_gmt":"2020-09-22T14:55:08","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=689037"},"modified":"2023-03-24T03:17:31","modified_gmt":"2023-03-24T10:17:31","slug":"hsd","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/hsd\/","title":{"rendered":"Project HSD: Holographic Storage Device for the Cloud"},"content":{"rendered":"
\n

\"OurThe enormous growth in demand for cloud storage has highlighted the need to rethink our storage systems from the media up. NAND flash and spinning hard disk drives are the mainstays of today’s warm cloud storage but are no longer improving capacity exponentially; in addition they face\u00a0\u00a0reliability and performance challenges due to the mechanical moving parts in hard disk drives and the declining endurance of flash cells.<\/p>\n

Project HSD is a collaboration between Microsoft Research Cambridge<\/a> and Microsoft Azure to re-imagine an old idea – holographic storage<\/a> – as a cloud-first design. We are capitalizing on the recent exponential improvement and commoditization in optical technologies such as smartphone cameras, as well as the unique opportunity to design at cloud scale.<\/p>\n

Our interdisciplinary team comprises experts in physics, optics,\u00a0machine learning, and storage systems; and our mission is to design\u00a0mechanical-movement free, high-endurance cloud storage that is both\u00a0performant and cost-effective. This has led to new research\u00a0challenges and breakthroughs in areas ranging from materials to\u00a0machine learning.<\/p>\n

Project HSD was publicly announced at Ignite 2020<\/a> by Mark Russinovich, CTO of Azure.\u00a0See Mark talk about HSD<\/a> and show a demo of it<\/span><\/span>\u00a0<\/span><\/span>(watch from 1h25 to 1h30) and<\/span><\/span> read the related blog post<\/a> for more details on HSD.<\/p>\n

Project HSD is part of the broader Optics for the Cloud<\/a> group at MSR Cambridge, which explores the future of cloud infrastructure at the intersection of optics and computer science.<\/p>\n

\n\t\n\t\tWe are hiring\t<\/a>\n\n\t<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Project HSD is a collaboration between Microsoft Research Cambridge and Microsoft Azure to re-imagine an old idea – holographic storage – as a cloud-first design. We are capitalizing on the recent exponential improvement and commoditization in optical technologies such as smartphone cameras, as well as the unique opportunity to design at cloud scale.<\/p>\n","protected":false},"featured_media":689202,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13547],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-689037","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-systems-and-networking","msr-locale-en_us","msr-archive-status-complete"],"msr_project_start":"","related-publications":[674811,1038207],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[{"id":0,"name":"How does Holographic Storage work?","content":"

What is Holographic Storage?<\/h2>\r\nHolographic storage was first proposed back in the 1960\u2019s shortly after the invention of the laser. Holographic optical storage systems store data by recording the interference between the wave-fronts of a modulated optical field, containing the data, and a reference optical field, as a refractive index variation inside the storage media. It is this information containing refractive index variation that is the \u201chologram\u201d. The stored data can then be retrieved by diffracting only the reference field off the hologram to reconstruct the original optical field containing the data.\r\n\r\nHolograms can be created in polymer and electro-optic crystalline materials by exposing the material to a modulated optical field i.e. the interference pattern between the data and reference optical fields. In polymers the holograms are stored as a permanent change in the material and provide a Write Once Read Many (WORM) storage solution. Holographic storage in polymers for archival storage has been actively pursued as the successor to blue ray, however, this technology has yet to see commercial success.\r\n\r\nIn electro-optic crystalline materials the hologram is stored as a spatial variation in the distribution of the electron density inside the host crystal which due to the electro-optic effect, causes the refractive index to also vary spatially. The spatial distribution of the electrons can be changed by exposure to light of a lower energy wavelength, e.g. green light, to write holograms, and reset by exposure to a higher energy wavelength, e.g. UV, to erase the stored holograms. After UV erasure the media can be reused to write further holograms, thus electro-optic materials provide a Rewritable, Read Many media.\r\n\r\nThe hologram stores information in a 3D volume and thus provides 3 degrees of freedom when it comes to storing information. In polymer materials the thickness of the material is limited by scattering so typically thin layers of material are used which limits the capacity that can be achieved and necessitates the use of spinning media to achieve acceptable capacities e.g. 300GB in a CD size for factor. In electro-optic crystals large volumes (10s of cubic millimetres) can be used which allows the 3D nature of this storage technology to be fully exploited. In 2000 IBM were able to demonstrate\u00a0impressive storage capacities\u00a0in an electro-optic crystal, Iron doped Lithium Niobate (LiNbO3:Fe).\u00a0However for the storage requirements of the time Hard Disk Drives proved to be a more compelling technology.\r\n\r\nIn Project HSD we are\u00a0exploring\u00a0the use of\u00a0holographic storage in\u00a0rewritable electro-optic materials\u00a0for warm data storage\u00a0to see if this technology makes sense in the cloud era.\r\n\r\n[row][column class=\"m-col-12-24\"]\r\n\r\n[embed]https:\/\/www.youtube.com\/watch?v=4EADwGV5Gv8&feature=youtu.be[\/embed]\r\n\r\nHow does holographic storage work?\r\n\r\nThis video shows how holographic storage works, using green light to write data as a persistent hologram inside an optical crystal. The data can then be read back from the hologram using another green light signal. The media is rewritable after erasure with UV light\r\n\r\n[\/column]\r\n\r\n[column class=\"m-col-12-24\"]\r\n\r\n[embed]https:\/\/www.youtube.com\/watch?v=CfME3e7aSNk&feature=youtu.be[\/embed]\r\n\r\nThe physics of hologram formation in iron doped lithium niobate\r\n\r\nThis video shows what is happening inside the lithium niobate media when a data page hologram is written.\r\n\r\n[\/column][\/row]"}],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Grace Brennan","user_id":40961,"people_section":"Project Team","alias":"t-gbrennan"},{"type":"user_nicename","display_name":"Nathanael Cheriere","user_id":40843,"people_section":"Project Team","alias":"ncheriere"},{"type":"user_nicename","display_name":"Jiaqi Chu","user_id":39147,"people_section":"Project Team","alias":"jiaqchu"},{"type":"user_nicename","display_name":"Jannes Gladrow","user_id":40714,"people_section":"Project Team","alias":"jagladro"},{"type":"user_nicename","display_name":"Doug Kelly","user_id":40711,"people_section":"Project Team","alias":"dougkelly"},{"type":"user_nicename","display_name":"Dushyanth Narayanan","user_id":31659,"people_section":"Project Team","alias":"dnarayan"},{"type":"user_nicename","display_name":"Greg O'Shea","user_id":31908,"people_section":"Project Team","alias":"gregos"},{"type":"user_nicename","display_name":"Ant Rowstron","user_id":31061,"people_section":"Project Team","alias":"antr"},{"type":"user_nicename","display_name":"Benn Thomsen","user_id":37104,"people_section":"Project Team","alias":"bethomse"},{"type":"user_nicename","display_name":"Xingbo Wu","user_id":41287,"people_section":"Project Team","alias":"xingbowu"},{"type":"user_nicename","display_name":"Mengyang Yang","user_id":39399,"people_section":"Project Team","alias":"meny"},{"type":"guest","display_name":"Kyriaki Margarita Bintsi","user_id":763210,"people_section":"Alumni","alias":""},{"type":"guest","display_name":"Sarah Lewis","user_id":689589,"people_section":"Alumni","alias":""},{"type":"guest","display_name":"Tony Mason","user_id":721363,"people_section":"Alumni","alias":""},{"type":"guest","display_name":"Soujanya Ponnapalli","user_id":698563,"people_section":"Alumni","alias":""},{"type":"guest","display_name":"Michael Rudow","user_id":763207,"people_section":"Alumni","alias":""},{"type":"guest","display_name":"Pedro da Costa","user_id":781738,"people_section":"Alumni","alias":""}],"msr_research_lab":[199561],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/689037"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":31,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/689037\/revisions"}],"predecessor-version":[{"id":745372,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/689037\/revisions\/745372"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/689202"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=689037"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=689037"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=689037"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=689037"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=689037"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}