![\"Professor](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/02\/MicrosoftTeams-image-17-1024x576.webp\")
Those people often go on to tell us they had barely realised this technology existed. Or they seem to believe it\u2019s brand new. However, the HoloLens has been around for five years and it\u2019s currently in its second iteration.<\/p>\n\n\n\n
In many ways, this discrepancy is understandable. If clinicians and healthcare professionals haven\u2019t experienced mixed reality for themselves they can easily dismiss HoloLens alongside the litany of over-hyped innovations which eventually go nowhere.<\/p>\n\n\n\n
Also, if you\u2019re of a certain generation in the UK, and grew up watching programmes like \u2018Tomorrow\u2019s World\u2019 \u2013 you could be forgiven for having an almost reflexive scepticism about some technology. After all, wasn\u2019t everyone supposed to have a jetpack by about 1995? And whatever happened to meals in \u2018pill form\u2019?<\/p>\n\n\n\n
Oddly enough, that scepticism is far less evident in the NHS. There seemed to be a fervent appetite for innovation within several of the trusts we work with. Recently, digital modernisation and innovation has accelerated. That momentum is showing no signs of waning. This enthusiasm is spreading to mixed reality, and HoloLens 2 in particular.<\/p>\n\n\n\n
But before we go any further and talk about some of the ways HoloLens is being applied in the NHS \u2013 we should probably establish exactly what we mean by \u2018mixed reality\u2019.<\/p>\n\n\n\n
Mixed reality in focus<\/h2>\n\n\n\n
\u201cOh, so this is augmented reality, is it?\u201d<\/p>\n\n\n\n
\u201cWhat\u2019s this, a VR headset?\u201d<\/p>\n\n\n
![\"Group](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/01\/HLS19_healthcare2Hologram_001-1024x683.webp\")
<\/figure><\/div>\n\n\n\nTwo of the questions we frequently get asked when attending events like Giant Health. And to be fair, the person on the street is far less familiar with the concept of mixed reality, as opposed to augmented reality (AR) and virtual reality (VR).<\/p>\n\n\n\n
AR overlays a digital element onto the physical world while VR creates a wholly separate virtual world. Mixed reality is about blending the physical and the digital together. The phrase we often use at Microsoft is: Embedding computing into the real world, and the real world into computing.<\/p>\n\n\n\n
In other words, when you\u2019re wearing a HoloLens 2 headset, you can still see the real world. But you\u2019re bringing in interactive digital content. And as you move around the space in the real world, that digital content remains in a fixed position. If you drop a virtual ball, for example, it will hit the ground and bounce back at you \u2013 because HoloLens is aware of and constantly mapping out your real environment.<\/p>\n\n\n\n
How the NHS innovates and collaborates with the HoloLens<\/h2>\n\n\n\n
Over the last couple of years, we\u2019ve been consistently impressed by the eagerness on the part of the NHS to experiment with technology and innovate. In fact, when it comes to mixed reality, it\u2019s no exaggeration to say the NHS is at the very forefront.<\/p>\n\n\n\n
One of the projects we\u2019re particularly proud of is our collaboration with Imperial College Healthcare NHS Trust<\/a>.<\/p>\n\n\n\n When the pandemic hit, the trust found itself on the frontline. Not only treating patients but trying to simultaneously protect its frontline staff inside some of the busiest hospitals across the most high-risk areas of London. They began using HoloLens 2 with Dynamics 365 Remote Assist and Microsoft Teams to reduce the number of people needed on ward rounds. <\/p>\n\n\n A doctor wearing a HoloLens headset would send a secure live video feed to a computer screen in a nearby room. This allows the rest of the team to see and hear everything on the ward and support the doctor while remaining at a safe distance.<\/p>\n\n\n\n Imperial College Healthcare NHS Trust stated that HoloLens led to as much as an 83 percent reduction in the time staff needed to spend in high-risk areas. It also reduced the need for PPE significantly, because suddenly only the doctor with the headset needed it. Estimates even suggest that using HoloLens saved up to 700 items of PPE per ward, per week.<\/p>\n\n\n\n It\u2019s fair to say the success at Imperial College Healthcare NHS Trust created some momentum. We set up a monthly call with interested NHS trusts, so we could share knowledge and discuss other areas where the technology could be put to work. As we put the technology in the hands of clinicians and educators we saw innovative adoption from patient education to multi-disciplinary teams, surgical planning, to community outreach. In particular, it enables remote access to medical students to complete virtual ward rounds. We have seen development of procedural guides for nurse and clinician training and adoption of patient simulation software.<\/p>\n\n\n\n And one key outcome was our association with Health Education England<\/a> (HEE), which is the executive body for healthcare training across England. They were unable to effectively train staff on how to treat COVID-19 patients, while medical students were falling behind with their practical tutoring.<\/p>\n\n\n\n So, we assembled a team of top-tier partners, including Insight<\/a>, GigXR<\/a>, Fracture Reality<\/a> and Dimension<\/a>, to create training resources using HoloLens. This helped HEE address this growing skills gap and cross-train existing staff.<\/p>\n\n\n\n Likewise, Case Western University in the US used HoloLens to develop its \u2018HoloAnatomy\u2019 application<\/a>, which combines cadaver dissections with mixed-reality simulations. Students are, in some cases, improving their overall grades as a result of this initiative. In the longer term, students in the HoloAnatomy lab scored a staggering 50 percent better on their retention tests and required 40 percent less class time than previous years. Medical students can also use the HoloLens for remote education.<\/p>\n\n\n\n Results like this have led us to help found an independent body called the Holomedicine Association<\/a>. Here, medical professionals can come together, swap ideas and share best practice. The body is also exploring the standards, certifications, policies and research that will soon be vital, if mixed reality continues its current trajectory. <\/p>\n\n\n\n Of course, nothing beats real life, hands-on experience. Especially in education. We have no intentions to replace in-person interaction with mixed reality. Rather, we aim to complement it where possible. Clinicians can use mixed reality to build muscle memory undertaking mixed reality procedural training in simulation labs such as University of Michigan<\/a>, Imperial and East Lancashire Hospitals. Or experts can easily oversee student or community carer in the field to give guidance and supervision. Collaborative mixed reality platforms are enabling students to get exposure to training anywhere in the world. At Imperial, Michigan and Alder Hey, they are conducting Grand Ward Rounds using solutions such as JoinXR – Fracture Reality<\/a>.<\/p>\n\n\n\n However, there may also be times when practical experience is too hard to come by. For example, many surgeons have told us about those extraordinary, \u2018once in a career\u2019 procedures \u2013 and how useful mixed reality could be in preparing for them.<\/p>\n\n\n\n Likewise, there may be a handful of global experts in a single, rare condition or procedure \u2013 and they can\u2019t be in two places at once. Not physically, at least. But with mixed reality, they can consult and even play an active role in treatments on different continents in the same afternoon. Language doesn\u2019t present a barrier either, because the technology already exists to listen and translate voices within HoloLens, in real time. Partners such as ApoQlar<\/a> are enabling the ability to visualise medical image data in 3D and collaborate immersively.<\/p>\n\n\n\n That, in turn, feeds into a wider point about sustainability. Of course, a world-famous surgeon may have less need to jet around the globe if they can use HoloLens effectively. However, it\u2019s not just in such rarefied contexts that mixed reality can make healthcare greener.<\/p>\n\n\n\n For example, one of our partners operates care homes in an area of roughly eight square-miles around Torbay, Devon. That sounds like a small-level operation, doesn\u2019t it? Until we tell you that their community nursing team clocks over a million miles of travel per year. In that situation, a few dozen HoloLens headsets could help enable clinical experts to cover more patients and increase access to care \u2013 a remarkable environmental impact that two organisations, Kendall Care Homes<\/a> and Torbay Breast Care Unit<\/a>, are already seeing after adopting HoloLens 2 in 2021.<\/p>\n\n\n\n Innovation in healthcare is a huge topic. And while our special interest lies in mixed reality, that doesn\u2019t mean we\u2019re blind to the other startling breakthroughs in the sector. There are few more impressive than the application of AI and machine learning to diagnostics.<\/p>\n\n\n\n For example, at Microsoft, we’ve partnered with the Mental Health Trust to explore certain models for predicting psychotic episodes. Elsewhere, predicative analytics is being applied to conditions like sepsis and hypertension with impressive results. We are also seeing the use of mixed reality in teaching soft skills through programmable avatars and applications in rehabilitation.<\/p>\n\n\n\n The wider point is that we\u2019re not discussing this technology in the abstract. Mixed reality, AI and machine learning are not the jetpacks or pill meals of Tomorrow\u2019s World. Far from it. Tools like HoloLens 2 are being used by healthcare professionals in the NHS and elsewhere today. And the more we combine them with other capabilities like cognitive services and IoT \u2013 the more powerful they will become. <\/strong><\/p>\n\n\n\n Discover how digitally transforming your organisation can drive better experiences, better insights and better care.<\/a><\/p>\n\n\n\n Forrester Industry Report: Mixed Reality in Healthcare<\/a><\/p>\n\n\n\n![\"A](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/01\/DYN21_RemoteAssist_001-1024x679.webp\")
<\/figure><\/div>\n\n\n\nUsing innovation to build skills in students<\/h2>\n\n\n\n
Connecting experts and clinicians together remotely<\/h2>\n\n\n
![\"Three](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/01\/HLS19_healthcare1Hologram_001-1024x683.webp\")
<\/figure><\/div>\n\n\n\nNow is the time to commit to mixed reality<\/h2>\n\n\n\n
Find out more<\/h2>\n\n\n\n
Resources to empower your developer team <\/h2>\n\n\n\n
![\"Joe](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/01\/Joe_Varrasso.webp\")
<\/figure><\/div>\n\n\n\n![\"Alex](\"https:\/\/www.microsoft.com\/en-us\/industry\/blog\/wp-content\/uploads\/sites\/22\/2022\/01\/Alex_Karim.webp\")
<\/figure><\/div>\n\n\n\n