Those people often go on to tell us they had barely realised this technology existed. Or they seem to believe it’s brand new. However, the HoloLens has been around for five years and it’s currently in its second iteration.

In many ways, this discrepancy is understandable. If clinicians and healthcare professionals haven’t experienced mixed reality for themselves they can easily dismiss HoloLens alongside the litany of over-hyped innovations which eventually go nowhere.

Also, if you’re of a certain generation in the UK, and grew up watching programmes like ‘Tomorrow’s World’ – you could be forgiven for having an almost reflexive scepticism about some technology. After all, wasn’t everyone supposed to have a jetpack by about 1995? And whatever happened to meals in ‘pill form’?

Oddly enough, that scepticism is far less evident in the NHS. There seemed to be a fervent appetite for innovation within several of the trusts we work with. Recently, digital modernisation and innovation has accelerated. That momentum is showing no signs of waning. This enthusiasm is spreading to mixed reality, and HoloLens 2 in particular.

But before we go any further and talk about some of the ways HoloLens is being applied in the NHS – we should probably establish exactly what we mean by ‘mixed reality’.

Mixed reality in focus

“Oh, so this is augmented reality, is it?”

“What’s this, a VR headset?”

Two of the questions we frequently get asked when attending events like Giant Health. And to be fair, the person on the street is far less familiar with the concept of mixed reality, as opposed to augmented reality (AR) and virtual reality (VR).

AR overlays a digital element onto the physical world while VR creates a wholly separate virtual world. Mixed reality is about blending the physical and the digital together. The phrase we often use at Microsoft is: Embedding computing into the real world, and the real world into computing.

In other words, when you’re wearing a HoloLens 2 headset, you can still see the real world. But you’re bringing in interactive digital content. And as you move around the space in the real world, that digital content remains in a fixed position. If you drop a virtual ball, for example, it will hit the ground and bounce back at you – because HoloLens is aware of and constantly mapping out your real environment.

How the NHS innovates and collaborates with the HoloLens

Over the last couple of years, we’ve been consistently impressed by the eagerness on the part of the NHS to experiment with technology and innovate. In fact, when it comes to mixed reality, it’s no exaggeration to say the NHS is at the very forefront.

One of the projects we’re particularly proud of is our collaboration with Imperial College Healthcare NHS Trust.

When the pandemic hit, the trust found itself on the frontline. Not only treating patients but trying to simultaneously protect its frontline staff inside some of the busiest hospitals across the most high-risk areas of London. They began using HoloLens 2 with Dynamics 365 Remote Assist and Microsoft Teams to reduce the number of people needed on ward rounds.  

A doctor wearing a HoloLens headset would send a secure live video feed to a computer screen in a nearby room. This allows the rest of the team to see and hear everything on the ward and support the doctor while remaining at a safe distance.

Imperial College Healthcare NHS Trust stated that HoloLens led to as much as an 83 percent reduction in the time staff needed to spend in high-risk areas. It also reduced the need for PPE significantly, because suddenly only the doctor with the headset needed it. Estimates even suggest that using HoloLens saved up to 700 items of PPE per ward, per week.

Using innovation to build skills in students

It’s fair to say the success at Imperial College Healthcare NHS Trust created some momentum. We set up a monthly call with interested NHS trusts, so we could share knowledge and discuss other areas where the technology could be put to work. As we put the technology in the hands of clinicians and educators we saw innovative adoption from patient education to multi-disciplinary teams, surgical planning, to community outreach. In particular, it enables remote access to medical students to complete virtual ward rounds. We have seen development of procedural guides for nurse and clinician training and adoption of patient simulation software.

And one key outcome was our association with Health Education England (HEE), which is the executive body for healthcare training across England. They were unable to effectively train staff on how to treat COVID-19 patients, while medical students were falling behind with their practical tutoring.

So, we assembled a team of top-tier partners, including Insight, GigXR, Fracture Reality and Dimension, to create training resources using HoloLens. This helped HEE address this growing skills gap and cross-train existing staff.

Likewise, Case Western University in the US used HoloLens to develop its ‘HoloAnatomy’ application, which combines cadaver dissections with mixed-reality simulations. Students are, in some cases, improving their overall grades as a result of this initiative. In the longer term, students in the HoloAnatomy lab scored a staggering 50 percent better on their retention tests and required 40 percent less class time than previous years. Medical students can also use the HoloLens for remote education.

Results like this have led us to help found an independent body called the Holomedicine Association. Here, medical professionals can come together, swap ideas and share best practice. The body is also exploring the standards, certifications, policies and research that will soon be vital, if mixed reality continues its current trajectory.  

Connecting experts and clinicians together remotely

Of course, nothing beats real life, hands-on experience. Especially in education. We have no intentions to replace in-person interaction with mixed reality. Rather, we aim to complement it where possible. Clinicians can use mixed reality to build muscle memory undertaking mixed reality procedural training in simulation labs such as University of Michigan, Imperial and East Lancashire Hospitals. Or experts can easily oversee student or community carer in the field to give guidance and supervision. Collaborative mixed reality platforms are enabling students to get exposure to training anywhere in the world. At Imperial, Michigan and Alder Hey, they are conducting Grand Ward Rounds using solutions such as JoinXR – Fracture Reality.

However, there may also be times when practical experience is too hard to come by. For example, many surgeons have told us about those extraordinary, ‘once in a career’ procedures – and how useful mixed reality could be in preparing for them.

Likewise, there may be a handful of global experts in a single, rare condition or procedure – and they can’t be in two places at once. Not physically, at least. But with mixed reality, they can consult and even play an active role in treatments on different continents in the same afternoon. Language doesn’t present a barrier either, because the technology already exists to listen and translate voices within HoloLens, in real time. Partners such as ApoQlar are enabling the ability to visualise medical image data in 3D and collaborate immersively.

That, in turn, feeds into a wider point about sustainability. Of course, a world-famous surgeon may have less need to jet around the globe if they can use HoloLens effectively. However, it’s not just in such rarefied contexts that mixed reality can make healthcare greener.

For example, one of our partners operates care homes in an area of roughly eight square-miles around Torbay, Devon. That sounds like a small-level operation, doesn’t it? Until we tell you that their community nursing team clocks over a million miles of travel per year. In that situation, a few dozen HoloLens headsets could help enable clinical experts to cover more patients and increase access to care – a remarkable environmental impact that two organisations, Kendall Care Homes and Torbay Breast Care Unit, are already seeing after adopting HoloLens 2 in 2021.

Now is the time to commit to mixed reality

Innovation in healthcare is a huge topic. And while our special interest lies in mixed reality, that doesn’t mean we’re blind to the other startling breakthroughs in the sector. There are few more impressive than the application of AI and machine learning to diagnostics.

For example, at Microsoft, we’ve partnered with the Mental Health Trust to explore certain models for predicting psychotic episodes. Elsewhere, predicative analytics is being applied to conditions like sepsis and hypertension with impressive results. We are also seeing the use of mixed reality in teaching soft skills through programmable avatars and applications in rehabilitation.

The wider point is that we’re not discussing this technology in the abstract. Mixed reality, AI and machine learning are not the jetpacks or pill meals of Tomorrow’s World. Far from it. Tools like HoloLens 2 are being used by healthcare professionals in the NHS and elsewhere today. And the more we combine them with other capabilities like cognitive services and IoT – the more powerful they will become.

Find out more

Discover how digitally transforming your organisation can drive better experiences, better insights and better care.

Forrester Industry Report: Mixed Reality in Healthcare

Resources to empower your developer team

Introduction to mixed reality

Mixed reality toolkit

About the authors

Joe Varrasso is the Europe Mixed Reality Partner Lead, building out an ecosystem of key industry partners helping to innovate with Mixed Reality in key industries. Specifically, Joe has also been focussed on the Healthcare Industry and is a Founding Member of the Holomedicine Association. 

Alex leads the IoT and Mixed Reality businesses for Microsoft UK. Prior to Microsoft, Alex led the deployment of HoloLens 2 for McLaren and later worked with Microsoft partner Kognitiv Spark. In his new role at Microsoft, Alex is focussed on accelerating the adoption of Metaverse technologies such as Mixed Reality, IoT and Azure in the UK.

The post How the healthcare sector is innovating appeared first on Microsoft Industry Blogs - United Kingdom.

March 2020. As the COVID-19 reached the UK, we had a theory that Dynamics 365 Remote Assist could work beyond industrial scenarios. It could transform healthcare.

Introducing Microsoft HoloLens 2 for remote assistance

I recently spoke with James Kinross, Senior lecturer in colorectal surgery and consultant surgeon at Imperial College Healthcare Trust NHS. “If you wind back to early March, which in COVID-19 times seems like a lifetime ago, we had a genuine amount of fear and anxiety about what was going to happen,” he said. “As it is to this day, the major issues we have is around staff protection and delivery of patient care.”

Colin Brown is CCIO at University Hospitals of Morecambe Bay NHS Foundation Trust. His Trust has a small federated hospital with limited staffing in a semi-rural area. By the end of March, it was still uncertain as to whether the volume of patients with COVID-19 would overwhelm the NHS, hospital services, and their staffing limits.

NHS hospitals across the country, serving both adult and children in acute and convalescent care have never been tested against such pressure. Rafael Guerrero, from Alder Hey Children’s Hospital, was worried that there would be delays in children’s heart surgery. He was worried his team would run out of capacity to monitor and deliver care to the whole region of North West of England, Cumbria, and North Wales.

Over the last three months, we worked with a consortium of NHS Trusts, Medical iSight, and Insight to use HoloLens 2 and Remote Assist to begin solving these problems. We recently published our initial use case on how it helps protect doctors while providing patient care.

How HoloLens 2 with Dynamics 365 Remote Assist works

We recently launched HoloLens 2 – a fully untethered, wearable holographic computer. It allows users to place 3D digital models in the room alongside them and interact with them using gestures, gaze, and voice. Mixed reality is at the forefront of transformative technologies and the impact and results are substantial.

Using Dynamics 365 Remote Assist, doctors wearing the HoloLens 2 on COVID-19 wards can be heads-up and hands-free. They can hold video calls with colleagues and experts from anywhere in the world. They can receive advice, interact with the caller and the patient at the same time. Medical notes and x-rays can also be placed alongside the call in the wearer’s field of view.

In this series of blogs, I wanted to take the key learning points and share them across the healthcare community. I hope it continues to foster more dialogue on how we can use the innovations within HoloLens 2 and mixed reality to support and transform outcomes.

Defining and implementing HoloLens and Dynamics 365 Remote Assist

The principle priority across the NHS Trusts has been to use the technology to improve staff safety. Advanced technology, especially remote evaluations of patient and communication between specialist care teams have made this possible, whilst maintaining social and physical barriers. Also, the consequential outcome was to limit the demand for PPE usage, enabling supply to be adequately distributed between hospitals. Individual case examples arose from local needs by specific team structures. In this blog, we will go into more details on considerations the teams took.

Measuring patient access and clinical effectiveness

Imperial NHS Trust has taken the lead on collecting qualitative data. They have collected information relating to their key outcomes of patients safety and PPE use. They have been collecting feedback from staff relating to how easy the technology is to use. They’ve also looked at the perceived impact on care quality, communication, and teamwork. In this blog, we will share more specifics along with patient feedback.

What’s next: How can other NHS Trusts get involved?

Now that we have established the use case for Dynamics 365 Remote Assist, our NHS partners are looking to embed the benefits of the HoloLens 2 as an everyday tool. To do this within healthcare, the approach they are taking is twofold: First, they are looking to create a structured approach for a wider trial to effectively demonstrate impact in a transparent and robust way. Second, they are exploring new use cases with our mixed reality Partners, who have existing applications for medical training, surgical planning, interoperative surgical capabilities, patient education, and more.

In this blog, we will share some of the examples of what our NHS Trusts are looking to do next, and also share ways for other NHS Trusts to get involved

What technology was needed to get started

HoloLens 2 is now widely available to businesses through authorised resellers such as Insight. Dynamics 365 Remote Assist is an application that can be securely managed within an enterprise environment. It is also further optimised with the Microsoft 365 and NHS recent announcements. With Medical iSight’s extensive experience with Imperial College NHS through their previous work in developing surgical guidance apps for plastic and reconstructive surgery, they were able to provide invaluable support to effective rapid deployment. They have worked with Insight across this consortium to package the best practices and created a free Remote Assist Fast Start for NHS organisations who purchase HoloLens 2 through Insight. In this blog, we’ll share more details on how to get started.

Thank you to the NHS and our partners

I’d like to thank the following for their contributions and penmanship. Colin Brown, CCIO at University Hospitals of Morecombe Bay; Guy Martin, Consulting Surgeon at Imperial College Healthcare NHS Trust; James Kinross, Senior Lecturer and Consulting Surgeon, Imperial College Healthcare NHS Trusts; Rafael Guerrero, Consultant Congenital Cardiac Surgeon, Clinical Director of Cardiac Services & Director of Innovation, Alder Hey Children’s NHS Foundation Trust; Phuoc Duong, Paediatric Cardiology Consultant, Alder Hey NHS Foundation Trust; Andrew Lewington, Associate Medical Director of Education, Leeds Teaching Hospital Trust;  Philip Pratt, Chief Scientific Officer, Medical iSight; Wes Platel, UK Digital Innovation Lead, Insight.

It’s been the greatest privilege to work alongside this collective of amazing people within the NHS, Medical iSight, Insight, and our Microsoft teams who have truly worked above and beyond to help protect NHS staff while delivering patient outcomes.

Find out more

Defining and implementing Remote Assist use cases

Measuring patient and clinical effectiveness

What’s next: How can other NHS Trusts get involved?

What technology was needed to get started

About the author

Leila has been working on the commercial mixed reality business for the last five years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe

The post How HoloLens and Dynamics 365 Remote Assist helps the NHS provide patient care appeared first on Microsoft Industry Blogs - United Kingdom.

Starting from the beginning of March, we’ve learned a tremendous amount around the use of the HoloLens 2. We now want to use this to help inform our journey as we move forward with more NHS Trusts and more use cases.

Defining the objectives for the remote assist use case

The healthcare service faces unprecedented challenge when necessities such as physical contact with patients, close teamwork, and regular face-to-face communication suddenly become a luxury.

One of our partners, Imperial College Healthcare NHS Trust defined their objectives as:

“The overriding priority for Imperial was to utilise the technology to improve staff safety, and as a secondary output reduce PPE use. This needed to be achieved whilst at least maintaining the same quality of care for patients. The individual use cases then were found based on team structures and staff who were keen to participate and drive the project forward.”

Guy Martin, Department of Surgery and Cancer, Imperial College Healthcare NHS Trust

On the other side of the country at Alder Hey Children’s Hospital, Rafael Guerrero and his team look after children with congenital heart disease in the North West of England, Cumbria, and North Wales. “We have to quickly adopt the HoloLens 2 and the Remote Assist platform to help our local specialists look after these sick children when they are waiting for the operation,” Guerrero said. “The parents need to be assured that the care of their children is not compromised, and to do this, we need good technology that is proven to work.”

Process for choosing wards and use cases

Patient care and staff safety

Imperial’s objective was to create “entirely virtual ward rounds”, using the HoloLens 2 as a way to share information and communicate more effectively “at the bedside”.

The first ward the team focussed on was the COVID-19 ward. It was flooded with patients and general medical teams would have high exposure rates. A classic ward round would include a consultant physician, with two or three juniors plus nurses. That makes a potential seven or eight frontline NHS staff exposed with each patient.

In the second ward, the team focused on an area delivering specialist invasive respiratory support. Experts are often distributed throughout the hospital so that the value of bringing in an expert into the bedside virtually is invaluable. In addition, the aerosol generating procedures utilised whilst providing respiratory support placed staff at a much higher risk of infection.

These two examples were also adopted at the Heart Centre at Alder Hey. The number of staff contact per patient during the ward round was five or seven. This was reduced to just one or two with the use of the HoloLens 2 with Dynamics 365 Remote Assist.

St. Mary’s within Imperial Healthcare NHS Trust, is also a major trauma centre, so that was another key area, alongside the surgery department. The ability for quick remote collaboration with an expert from any discipline, can have major benefits. Not only was the interpretation of the main operator communicated to the external experts, but the entire team can share direct visuals of the problem. This saves time and improves the accuracy.

Cardiac unit doctors and nurses promptly adopted this unique communication platform. This helped to deliver care at the same standard as it was before social distancing was enforced. Expert care, efficiency, or staff safety were not compromised by the physical barrier imposed by infection control.

Each of the four use cases were up and running by the end of March and in consistent use with results covered.

Remote expert advice

Morecambe Bay are a group of small, district general hospitals with limited staffing in a semi-rural area. Because of this, their use cases are focused on using Dynamics 365 Remote Assist to train middle-level clinicians such as Specialist Registrars and clinical nurse specialists. They can then make Teams calls to their on-call Respiratory Consultant Physician, who may be in a different part of the hospital, or on call overnight at home, or in a different hospital in the region. This allows them to take the bedside and patient, wherever they are, and support assessments and appropriate treatment plans, including where necessary, rapid escalations of care.

The Alder Hey Heart team has also carried out a pilot supporting non-expert echocardiographers (middle grade cardiology trainees, or paediatricians with interest, or non-paediatric echocardiocardiographers) to perform complex ultrasound scans of children’s hearts remotely. Cardiologist Dr Phuoc Duong has articulated that there was “perfect vision” of the echo machine screen and the ability to guide the non-expert operator in real-time. These are also perceived as excellent training opportunities for novices. They are aiming to run a follow-up study on the benefit of training once the pandemic is downgraded.

Clinical education

Like many teaching hospitals in the country, the Imperial College NHS Trust team undertakes vital training roles to future undergraduate and postgraduate doctors. Virtual training rounds have now started to be implemented with positive initial feedback.

For Leeds Teaching Hospital Trust:

“Our aim is to explore new technologies to improve medical education. We have partnered with the Microsoft lead ResilientXR consortium alongside Health Education England to build COVID-19 content. In addition, we see a significant opportunity to train the next generation of medical students and have developed a core team of trainees and fourth year medical students to explore mixed reality use cases across the hospital including applications in oncology, intensive care, surgery, and also engage with colleagues in the community”

Andrew Lewington, Associate Medical Director of Education, Leeds Teaching Hospital Trust

What were keys to successful implementation?

James Kinross and Rafael Guerrero both shared that in the beginning, there was a fair degree of anxiety. To actually try to deploy new technology in the middle of a storm is hard to do. There’s less resources and less in-person IT support. You’re asking your frontline care workers to do technically difficult things while they’re cognitively over-burdened and stressed and sometimes can’t conceptualise what new technologies can do.

To this end, there are key tips that are worth calling out:

• It’s critical that when the doctor or nurse puts on the HoloLens and makes their first call, it’s ready to go, including compliance, security, and manageability.
• One of the first things that the NHS teams did, were to ensure that HoloLens could work effectively with various different types of PPE – including full face masks. They were able to do this pretty easily with some low-tech solutions. Imperial are planning for longer-term solutions with 3D printed additions.
• Cleaning of HoloLens was also very straightforward within the NHS as they have many protocols for how equipment and devices get cleaned. The NHS found that through collaborating within the consortium, they were also able to leverage best practices very quickly.
• And finally, from a data governance perspective, it was important that patient privacy was adhered to. This included ensuring that clinicians wearing the HoloLens are always identifying what HoloLens is, why they are wearing it, and what the other healthcare workers on the end of the Teams call can see and hear. There were also decisions about what data they would and would not record, in adherence with internal data governance policies.

Identifying and supporting end-user adoption

In the case of Morecambe Bay, CCIO Colin Brown spent a fair bit of time in the first few weeks engaging across the physical NHS Trust locations to meet with Respiratory Consultants, Specialist Registrars, Clinical Nurse Specialists, and Ward Nurse Managers to secure their interest, engagement, and adoption.

At Alder Hey Children’s Hospital, Rafael Guerrero showcased his examples starting from the Heart Centre, with quality improvement survey results to the hospital executive boards. He then subsequently expanded to meetings with heads of departments and education partners from the local universities.

From the Imperial perspective, they also met with many different physicians across Imperial. They showcased the technology to see if there was an immediate use case. If not, they didn’t try to force it. However, what they found is that as teams have more bandwidth or have experienced HoloLens on the Teams-side of the call, they are seeing significantly more requests by others to adopt this technology for remote collaboration.

Getting the foundational use case right

By starting with remote assist, HoloLens is being seen as a functional tool to support remote collaboration and it is adopted on this basis. However, it only taps into a limited amount of the HoloLens functionality. Clinicians are asking for more capability, such as integrating Electronic Health Records. These requests are being easily solved without significant development resources.

Find out more

How HoloLens and Dynamics 365 Remote Assist helps the NHS provide patient care

Measuring patient and clinical effectiveness

What’s next: How can other NHS Trusts get involved?

What technology was needed to get started

About the author

Leila has been working on the commercial mixed reality business for the last five years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe

The post Defining and implementing HoloLens and Dynamics 365 Remote Assist use cases appeared first on Microsoft Industry Blogs - United Kingdom.

Partnering with Imperial College Healthcare NHS Trust has been particularly helpful for us to establish patient and clinical effectiveness for the HoloLens 2 and Dynamics 365 Remote Assist. It is a Top 10 global university committed to research excellence and operates five hospitals in London with 11,000 staff.

In addition to helping to define the use cases, the team has helped to establish measurement approaches. These approaches have been used to support as we started to engage other NHS Trusts.

It’s important to recognise that this still at the beginning and early days but an important step forward.

Initial use case focus for measuring effectiveness

The previous blog looked at defining and implementing Dynamics 365 Remote Assist use cases. Therefore, I’m keen to reiterate the specific use cases that Imperial initially focussed on:

1. Remote ward rounds to reduce COVID-19 exposure and PPE use: Rather than having multiple doctors and nurses pushing a computer around as they make decisions about patients, the Imperial team could send one physician wearing HoloLens. This means they can reduce the amount of doctors and nurses needed for single rounds whilst reducing the amount of PPE used.
2. Reduce contact: The doctor wearing the HoloLens no longer needed to touch a computer. This lessens the risk of unwittingly transmitting the virus and reduces the amount of extra cleaning or computer-specific protection equipment.
3. Increase access to patient information: With HoloLens you can remotely talk to team members or doctors, at the patient’s bedside without them physically being in the same room. You can see and interact with any of that patient information virtually so you don’t need to touch anything. You can even interact and manipulate those images in a heads-up view next to the patient.

Study methodology

To measure patient and clinical effectiveness, the Imperial team collected data pertaining to the key outcomes of patient’s safety, time exposed to COVID-19 positive environments, and PPE use. They have also collected qualitative data from staff related to how easy the technology is to use, and the perceived impact on care quality, communication and teamwork.

The Imperial team has recently submitted their research for peer-review. Here are their preliminary findings:

• The HoloLens 2 reduces staff numbers per ward round by around 66 percent to 83 percent (depending on the environment).
• This equates to saving of 50.4 – 55.4 hrs of ward staff time per week.
• Savings in PPE ranged from 106 to 420 sets per ward per week.
• Staff felt the HoloLens 2 significantly improved communication for the sickest patients.

There is also significant opportunities to measure process improvements. This includes operational efficiencies. In some cases, Imperial are seeing a 30 percent reduction in the time that it takes to do ward rounds. This saves on travel time and many other factors that are important to measure.

What do the staff think?

Dr Louis Koizia, consultant physician and geriatrician at Imperial, has been one of the doctors using the HoloLens 2 daily since March. At the beginning of March, he did not think the HoloLens 2 would become an everyday tool. However, within four weeks of using HoloLens 2 and Dynamics 365 Remote Assist, he saw the significant improvements it was making. One of his biggest concerns was around whether it would be easy and comfortable to enable daily use.

“If you can ask me now, I can’t imagine going back to my old style ward rounds and we are only two months into it,” Dr Koizia said. “We are only using the technology at such a basic level with HoloLens 2 and Dynamics 365 Remote Assist as we needed it to work ‘out of the box’ and we needed it to do a job. It’s done that fantastically. I’m excited about what we are going to develop out and I’m certain that in a year or two’s time these will be used mainstream throughout the country.”

Improving patient care

It’s also important to take into account the input from patients and feedback has been quite positive.

Dr Koizia said patients are very used to seeing healthcare staff with PPE, gloves, masks and visors. So wearing the HoloLens 2 has been quite a natural addition. Explaining to patients why they are using the HoloLens 2, what the physician sees, but also what the team of healthcare professionals can see virtually is a very important part of the process. This has resulted in positive feedback from patients. They have a team of healthcare professionals working with them, while also ensuring that they themselves aren’t exposing staff.

Within Alder Hey, the team has been sensitive to ensure they get feedback from both the children and parents. Their findings have been that the children did not find the HoloLens 2 scary, and the parents were welcoming to the prompt adoption of technology. The doctors and nurses felt that patient care was more focussed as they were not distracted by other ward activities and traffic. Also, it has the advantage of relevant investigations instantaneously being shared between the teams.

“It just seems quite a good thing that you can have all those amount of people in the same room, in one person, when this contagious thing, that no-one knows the beginnings or the ends of it. They’re not only saving me, I’m not passing anything onto any one of them and their friends,” John, a patient at Imperial told BBC at 6.

Another patient was asked by The Economist whether it felt like it was technology that was diagnosing them or a person. “Always felt like a person, a whole group of doctors standing there in front of me, while there was only one person and they had more input because they had all of the data in front of them with the computer screens.”

What’s next

Next, they will publish the peer reviewed research on the patient and clinical effectiveness of the HoloLens 2 and Dynamics 365 Remote Assist. We also know that there is a lot more to do in this area. In the next blog, we’ll talk about how the team is thinking about what’s next and how can other NHS Trusts get involved.

Find out more

How HoloLens and Dynamics 365 Remote Assist helps the NHS provide patient care

Defining and implementing Dynamics 365 Remote Assist use cases

What’s next: How can other NHS Trusts get involved?

What technology was needed to get started

About the author

Leila has been working on the commercial mixed reality business for the last five years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe.

The post Measuring patient and clinical effectiveness appeared first on Microsoft Industry Blogs - United Kingdom.

We have seen significant experimentation with HoloLens 2 in health since we launched it back in 2015. Much of that work has been around doctors piloting within the advanced visualisation, pre-operative surgical planning, multidisciplinary team scenarios, patient education, and medical training to name a few.

Since 2015’s launch of HoloLens 1, the feedback from our Development Kit has been used to inform the development priorities of HoloLens 2. We designed HoloLens 2 to be more immersive, comfortable, and to help companies get started with out of the box applications for quicker time to market.

With the launch of HoloLens 2, we now have significant out of the box applications that include Dynamics 365 Remote Assist and Mixed Reality Partner applications. We have great examples for What HoloLens 2 Can Do today across industries, and how we can use these to transform health tech.

Continuing to prioritise remote assist scenarios across the NHS

My favourite starting point for the NHS Trusts is within remote assist scenarios. Previously, we talked about how remote assist started as a tool to help protect Imperial College NHS Healthcare Trust staff while delivering on patient care during COVID-19. It started in a few wards such as respiratory and has now been extended into renal and trauma wards. It’s also being used for undergraduate and graduate training scenarios across many Trusts.

The technology was applied in both adult and paediatric settings. It’s been used in open areas such as clinics/ward and confined areas such as operating theatres. Across many Trusts, it’s assisted during delivery-intense clinical service such as surgery, to teaching for undergraduate and graduate training scenarios.

We also are seeing the potential applications and pilots are in process right now for distributed geographic care and primary care scenarios.

There is a great opportunity to connect HoloLens 2 and Dynamics 365 Remote Assist to Electronic Health Records. By doing so, we can leverage tools such as Power Platform, Dynamics 365 Customer Service, and Dynamics 365 Field Service. This means we can ensure we provide the right information at the right place and time, with the right data governance structures.

Expanding use cases with mixed reality partners

There’s more to HoloLens 2 than remote assist. We also have significant interest from NHS Trusts to work with partners. Here are some examples we are seeing from our innovative partners:

Case Western Reserve University has built a HoloAnatomy curriculum. In a Medical Science Educator journal study, students using HoloAnatomy required 40 percent less classroom time to cover the required learning than those doing dissection. This year, they sent 185 HoloLens to their first year medical students so they could keep studying. We’re seeing others, including Oxford University, looking to bring this to the UK.

ApoQlar has been building a Virtual Surgery Intelligence platform that is being used by various hospitals around the world – from Marien Krankehaus to the Newcastle upon Tyne Hospitals NHS Trust. Offerings include Surgery, Surgery Planning, Telemedicine, Documentation, Patient Education, and Teaching applications. The platform uses AI to segment and present MRI and CT scans in 3D.

Medivis has been building out a SurgicalAR and AnatomyX platform for healthcare. SurgicalAR is building the future of computer-assisted surgery by harnessing HoloLens and AI. It aims to improve surgical outcomes for patients and drive cost savings for medical institutions.

Philips is building Azurion, an image-guided therapy platform for minimally invasive surgery. It brings live imaging and other sources of data into a 3D holographic augmented reality environment. This can be ergonomically, easily, and intuitively controlled by the physician.

GigXR HoloPatient is a suite of standardised holographic simulations for safe and practical instructor-led development of clinical skills. Trainees can see, hear, and assess holographic patients with new pathologies that exhibit varied symptoms. They can easily see presentations of different illnesses or injuries.

ResilientXR is a partnership between digital creative industry, academia, and government. Made up of Microsoft, Dimension, Digital Catapult, VISR-VR, Fracture Reality, Make Real, University of Leeds’ Centre for Immersive Technologies, and University College London. The ResilientXR consortium identified immediate training needs for clinical staff during COVID-19. Within a few weeks, they developed and deployed to HEE interventions to meet these needs. This includes 2D videos, volumetric holographic videos, resources, and an immersive platform for management and global distribution of the XR content across devices.

In addition, we are working to onboard new partners such as Medical iSight, into our Mixed Reality Partner Program. The team at Medical iSight has had extensive experience with HoloLens since 2018. This has been invaluable to the current speed of deployment with existing use cases. Going forward, Medical iSight is developing a comprehensive platform for surgical planning, image-guided intervention, healthcare education, and remote clinical collaboration. In particular, it has a bespoke module for interventional neuroradiology, where live 2D imaging is spatially registered to pre-operatively acquired 3D scans, used during mechanical thrombectomy for the treatment of strokes.

Building the evidence base to measure effectiveness

As a collective, we have an opportunity to drive a structured approach for wider trials to continue to demonstrate impact in a transparent and robust way, both for the Dynamics 365 Remote Assist use case and for new use cases. We can share learnings and insights, including how we scale this out on a national and global basis.

Working with the NHS Trusts as a collaborative community

Insight are one of our key mixed reality partners, and also an authorised reseller of HoloLens 2. They can help advise on solutions and also has a practice to do custom development.

Insight has packaged the best practices and created a free Dynamics 365 Remote Assist Fast Start for NHS organisations who purchase HoloLens 2 through Insight.

Once you get set-up through this process, we will look forward to integrating you into the NHS Teams collaboration site that we have, for community Q&A and in sharing best practices.

Three years of innovation in three months, but let’s keep going

As I reflect on the past three months (which feels like a lifetime ago now!), I am deeply impressed with the work being done. With the NHS Trusts, I believe we have done something very profound in proving that we can get HoloLens 2 and Dynamics 365 Remote Assist deployed. The evidence proves that this technology can help protect NHS staff lives, while delivering new models of remote patient care.

We are still in the early days of tapping into the vast potential of HoloLens. However, we are already seeing more use cases being adopted by more NHS Trusts, social care, and medical schools.

With leadership from our leading clinicians within the NHS, our opportunity will be to continue to work as a collective with our partners like Insight, Medical iSight, and our mixed reality partners and deliver the full potential of this transformative technology.

Find out more

How HoloLens and Dynamics 365 Remote Assist helps the NHS provide patient care

Defining and implementing Dynamics 365 Remote Assist use cases

Measuring patient and clinical effectiveness

What technology is needed to get started

About the author

Leila has been working on the commercial mixed reality business for the last five years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe.

The post What’s next: How can other NHS Trusts get involved? appeared first on Microsoft Industry Blogs - United Kingdom.

In March, we rolled out Microsoft Teams for free to assist throughout COVID-19. Recently, the NHS announced it chooses Microsoft 365 to create a truly joined-up service. Both of these mean that innovations such as Microsoft HoloLens 2 and Dynamics 365 Remote Assist are far easier to adopt and use. A core requirement for Dynamics 365 Remote Assist is Microsoft Teams. Therefore, having the licenses and end-user adoption has allowed NHS Trusts to start deploying in days with limited friction. Often those familiar with HoloLens will say to others, “It’s heads-up Teams” and there is an immediacy of understanding.

Built-in security

To deploy new technology during challenging conditions, it was critical that its security met the needs of the NHS. Being natively integrated with Microsoft security technologies (like Azure Active Directory), the HoloLens 2 and Dynamics 365 Remote Assist can provide a security solution for connectivity. Leveraging Microsoft Intune to provide remote Mobile Device Management to easily configure and manage the devices. Azure Active Directory Conditional Access helps secure user access to the service. These allowed the NHS to meet their security needs whilst providing an excellent end user experience.

Conditional Access meant that the staff using the device could pick up a headset and have the minimum number of username/password prompts to quickly get working, whilst keeping the account secure with Multi-Factor Authentication against unwanted authentication attempts. Additionally, Microsoft Intune provided the ability to restrict the applications on the device to only a permitted list (Multi-app Kiosk Mode) to both minimise training time, and increase device security. Connectivity to the internet was achieved by using existing Wi-Fi networks with Microsoft Intune deploying security PSK or certificate based Wi-Fi profiles to the devices as appropriate for the secured networks available in the use locations.

It’s all about the data…

With any system collecting video or audio data, strict data governance requirements come into play to ensure patient privacy and confidentiality. Since the NHS had already adopted Microsoft Teams, this was simple to achieve. All the video and audio data collected through Dynamics 365 Remote Assist is subject to the same regulatory processing and storage requirements as Microsoft Teams. This means that the solution can be approved with the data protection teams confidently. They know that the data would be protected and meet the requirements already approved and in place.

Licences Required:

To implement the above design one of the following sets of licences is required:

• Microsoft Dynamics 365 Remote Assist
• and ONE of the following
  1. Microsoft 365 Enterprise E3
     • OR
  2. Microsoft Enterprise Mobility and Security (EM+S) E3
     • OR
  3. Azure Active Directory Premium P1 AND Microsoft Intune AND a suitable Microsoft Teams licence (for example Office 365 E3)

Best practice tips

Colin Brown, CCIO at University Hospitals of Morecambe Bay NHS Foundation Trust has shared that to support the purchasing of the HoloLens 2, a key enabler was digital leader discussions. Because they already have a full Microsoft tech stack, the IT department commitment was straightforward. They had early expert engagement with their Infection Prevention Team so were able to develop a standard operating protocol. This was to ensure the headset could be protected and cleaned in a virus-laden clinical environment.

Some additional great tips:

• Ensure a good deployment of Office 365 and Microsoft Teams.
• Ensure good co-design of use cases in acute provider, community, wider health and care systems, and between clinical leaders and IT.
• Develop conversations with consultant enthusiasts and digital leaders.
• Spend the time to get the first couple of end-users up and running on their first Dynamics 365 Remote Assist call. Once they have done a couple, they’ll start using it consistently.

How do you acquire HoloLens?

We have partnered with Insight who are one of our key mixed reality partners and an authorised reseller of the HoloLens 2. They can also advise on solutions, provide deployment, and managed services alongside custom development for apps on the HoloLens 2.

Insight’s Dynamics 365 Remote Assist Fast Start offering for the NHS

Insight has packaged the best practices and created a free Remote Assist Fast Start for NHS organisations who purchase HoloLens 2 through Insight.

This is designed for organisations considering Dynamics 365 Remote Assist with HoloLens 2, with mobile devices, or have HoloLens but haven’t started to actively deploy. The goal is to help get you going with minimum fuss. They’ll be using the best practices that we have garnered to get you up and running quickly.

This includes an introduction to HoloLens 2, Dynamics 365 Remote Assist overview, typical use cases in healthcare, technical considerations, and licenses. In addition, they will work to understand where you are at in your Teams deployment, walking you through steps for implementation.

Most importantly, they will take you through the HoloLens 2 out of the box experience, through to your first Dynamics 365 Remote Assist call.

Once you get set-up through this process, we will look forward to integrating you into the NHS Teams collaboration site that we have, for community Q&A and in sharing best practices.

Find out more

How HoloLens and Dynamics 365 Remote Assist helps the NHS provide patient care

Defining and implementing Dynamics 365 Remote Assist use cases

Measuring patient and clinical effectiveness

What’s next: How can other NHS Trusts get involved?

About the author

Leila has been working on the commercial mixed reality business for the last five years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe.

The post HoloLens and Dynamics 365 Remote Assist: What technology is needed to get started? appeared first on Microsoft Industry Blogs - United Kingdom.

There’s also the challenge of staying resilient and adapting to the changing needs of your business. In our whitepaper Reconciling the Irreconcilable, we look at the challenges faced by infrastructure projects and how interoperable solutions can help. By using a digital building lifecycle, the industry also has a key opportunity to boost sustainable industry growth, fix the supply chain, improve site safety and productivity, and drive innovation.

[msce_cta layout=”image_center” align=”center” linktype=”blue” imageurl=”http://approjects.co.za/?big=en-us/industry/blog/wp-content/uploads/sites/22/2020/06/whitepaper800x.jpg” linkurl=”https://info.microsoft.com/UK-DIGTRNS-CNTNT-FY20-06Jun-22-MSConstructionWhitePaper-AID-3013731-SRGCM3575_01Registration-ForminBody.html” linkscreenreadertext=”Download the whitepaper: Reconciling the Irreconcilable” linktext=”Download the whitepaper: Reconciling the Irreconcilable” imageid=”36465″ ][/msce_cta]

See how implementing smarter lifecycle management, flexible workplaces, or using technology to help your employees can address your needs and support your resilient operations.

1.      Workforce safety and protection

Employee safety and protection will always be a top priority for organisations. We also expect new processes and procedures to be implemented as the industry returns to site.

AI-infused IoT wearables and sensors in the field can also monitor and report to ensure health and safety best practices are being followed, or alert when there’s potential issues, like spills or leaks.

Microsoft HoloLens 2 infused with AI will allow employees to survey sites and create innovative, highly precise, sustainable solutions, delivered in an agile, flexible off-premises environment. It can also be used by on-site employees to access instructions hands-free while on the job.

2.      Connected Workers

Help employees stay engaged through Microsoft Teams and virtual desktop environments. Teams lets employees securely chat, meet, share and collaborate on files together no matter where they’re located. Virtual desktops enable employees to access the apps and information they need securely, from anywhere.

Additionally, use tools such as the HoloLens 2 and Dynamics Remote Assist will enable on-site employees to collaborate with experts in different locations. These tools also help upskilling employees with new processes.

3.      Smart lifecycle management

As the sector looks to control cash flow and make cost savings, whilst also planning ahead for economic recovery, it will be essential to optimise supply chains. Through better use of data across the supply chain, organisations can adapt to complex scenarios in real time.

Reduce physical onsite presence, and streamline operations with IoT technologies for remote monitoring, remote control, and automation of simple tasks.

You can then take advantage of the data collected to create processes and quickly adapt to changing working patterns. Deliver an intelligent, connected field service by moving from a costly break–fix model to proactive, predictive maintenance.

4.      Stay secure

As organisations move to more digital processes, it is critical organisations have security infrastructure in place to detect, respond, and protect against threats.

Microsoft builds its products with security-by-design, making it easy for your IT team to keep control of the whole digital estate. Think about implementing multi-factor authentication, conditional access, and creating strong security policies. Keep employee education up-to-date.

Help build a stronger future

We strongly believe there is a huge opportunity for technology to help transform the Built Environment Sector, whilst also supporting resilient operations.

By creating smart, interconnected sites, data, and people, we can bring together the skills and information today needed for tomorrow’s innovative projects. Which is a really exciting opportunity you don’t want to miss out on.

Find out more

Learn more about our vision for the Built Environment

4 ways the construction industry can use technology to fix the supply chain and empower employees

Learn how we’re supporting resilient operations

About the author

Adam has worked at Microsoft for over 13 years and is energised by the culture, direction, and strategy as an organisation. He is passionate about the amazing opportunity this provides to empower customers to achieve their goals.

Adam currently leads the Built Environment Team at Microsoft in the UK, where they enable the business outcomes of organisations in the Design, Engineering, Construction, and Facilities Management Industries through digital technology. The Built Environment sector is particularly interesting area to focus as there is a huge opportunity for the industry to transform and it has an impact on all of us in our daily lives.

The post How to support resilient operations in the Built Environment Industry appeared first on Microsoft Industry Blogs - United Kingdom.

But, now, we are entering the third wave of computing. From construction sites to factory floors, from operating rooms to classrooms; mixed reality, AI, the intelligent edge and intelligent cloud are changing how we work, learn, communicate and get things done.

We are at the dawn of a new age of computing. One in which the digital world goes beyond two-dimensional screens and enters our three-dimensional world, empowering people to achieve more, in ways we could only have imagined until now. And it all started with mixed reality, such as the HoloLens 2. When you can have native 3D, have data in context at your fingertips, and be heads-up and hands-free in your projects, you can get massive gains.

And it all started with mixed reality, such as the Microsoft HoloLens back in 2016 which was the world’s first untethered holographic computer that you could wear. Since 2016, we have had 87 percent of enterprises evaluating, piloting, and beginning to deploy. The findings are that when you can have native 3D, have data in context at your fingertips, and be heads-up and hands-free in your projects – you can get massive gains.

But with the announcement of HoloLens 2, we continue to set the high watermark for mixed reality and AI in the edge of computing.  And over the last 3 years, we’ve been hearing consistent feedback from you. You want greater immersion, greater comfort, and quicker time to value. With HoloLens 2, this is exactly what we’ve been focusing on.

Here are four reasons why your business needs a mixed reality strategy:

1. Empowering and protecting frontline workers

One of the most fundamental learnings that we’ve had with our customers over the last three years, is that this type of technology is empowering the frontline workers, who have often not had the same technology benefits as what the knowledge workers have benefitted from. Yet these workers are critical for organisations as they are the ones who are the closest to products and customers.

HoloLens is keeping essential healthcare workers safe, while significantly improving communications to help patients. Staff at Imperial College Healthcare NHS Trust are wearing the mixed-reality headset as they work on the frontline in the most high-risk area of some of London’s busiest hospitals. Using Remote Assist, doctors wearing HoloLens can hold hands-free Teams video calls with colleagues and experts anywhere in the world. They can receive advice, interacting with the caller and the patient at the same time, while medical notes and X-rays can also be placed alongside the call in the wearer’s field of view.

In construction, productivity in frontline workers has only grown 1 percent over the last two decades, which, when compared to knowledge workers who have benefitted greatly from technology is not a lot. Mixed reality lets these frontline workers access data and information on site, hands free, as they are working. This means they work quicker, make less mistakes, and stay connected to others.

In fact, according to the 2017 Forrester Consulting report, ‘Mixed Reality Unlocks New Ways for Organizations to Collaborate, Innovate, and Learn’ using mixed reality can boost productivity by 25 percent, while reducing errors to almost zero.

2. Improved training

We forget about 80 percent of what we learn after 30 days. This means we have to think about how we upskill and retrain our employees. By using mixed reality, you can provide hands-on visual learning at the touch of a button. Dynamics 365 Guides brings training to life with interactive content, photos, videos and 3D models bringing training. You can even use data to improve these experiences.

Plus, HoloLens can bring up manuals and guides while employees are working, offering a richer learning experience whenever they need it. It also provides training for situations that are hard to replicate in real-life, without real-life consequences such as machine breakdowns, construction issues, and even surgery.

CBRE is the world’s largest integrated real estate and facilities management company, serving major clients all around the globe. During a number of pilot projects on client sites, CBRE has seen the benefits of using mixed reality in remote collaboration for assisting their engineers and technicians to improve efficiency, collaboration and customer experiences. They also plan on using the HoloLens for training to create a more immersive learning experience, reduce travel costs and get employees up to speed faster, ensuring greater engineer confidence and better break-to-fix times for clients’ equipment and technical infrastructure to ensure maximum facility and asset uptime.

3. Remote servicing and collaboration

For some industries, technicians often travel all over to provide servicing, auditing, and maintenance on equipment. This can get costly and be time-consuming.

This is where a HoloLens with Dynamics 365 Remote Assist comes in. Your experts get a real-time view of a problem to troubleshoot efficiently. Not only does it reduce costs, but frontline workers will get training on how to solve the problem if it occurs again in the future. This type of instant collaboration is great way to solve problems quicker, while learning on the job.

At CBRE, an automation specialist on a life sciences account was asked to visit another of client’s site to carry out a repair and complete an application upgrade on some equipment. Unable to leave their current site, they were able to leverage the use of mixed reality to provide assistance.

“By using the HoloLens and the Remote Assist app, I was able to talk the engineers through the procedure whilst being able to see what they were doing,” they said. “This saved me valuable time and also provided training to the other engineers who carried out the work. It also saved possible call-out charges from the third-party vendor.”

4. Efficiency and quality gains

The best part of the HoloLens 2 is that it’s easy to use and comfortable, which means that your employees are more likely to reach out for it when they need to. It even fits over glasses. It adapts easily to the individual’s hand gestures, tracks eyes in real time, and is secure with Windows Hello. And with a range of apps already on the market, you can get up and running quicker than ever.

A 2018 Harvard Business Review report ‘A New Dimension of Work’ found that mixed reality improved field service and maintenance by four times. 80 percent of companies also reported it improved collaboration. Employees will be more engaged, productive, and knowledgeable.

Employee engagement has not just retaining benefits, but you’ll open yourself up to a wider talent pool. You’ll attract new labour and younger employees, while ensuring they can get to work quicker because they’re given the tools that they need to more easily learn.

From hospital wards to classrooms, construction sites to factory floors, mixed reality, AI, the intelligent edge and intelligent cloud are changing the way we work, learn, communicate, and get things done.

Mixed reality brings to life everything we need to contextualise work. This makes for fewer errors, faster and more productive employees, better training, improved employee safety and amazing collaboration abilities.

Find out more

Read the blog – What is mixed reality and is it right for your business?

Download the eBook – Mixed reality: Why nine out of ten businesses plan to use it

Explore the product – HoloLens 2 

About the author

Leila has been working on the commercial mixed reality business for the last four years and is based in the UK. She’s been working with some of the most advanced customers and partners in the world, helping them identify, pilot and deploy technologies that have a profound ability to transform their business.

Prior to joining the mixed reality team, she held several senior positions at Microsoft including leading consumer and commercial business units such as Server & Tools and Windows in the UK and Central & Eastern Europe

The post 4 reasons why every business needs a mixed reality strategy appeared first on Microsoft Industry Blogs - United Kingdom.

There were three things we announced during Build for Mixed Reality:

1. An expanded Mixed Reality Developer Program
2. A new HoloLens 2 Development Edition
3. Native integration between HoloLens 2 and the Unreal Engine 4

Mixed Reality Developer Program

In February, we launched HoloLens 2. Satya was on stage at MWC Barcelona, sharing our vision for how the intelligent cloud and intelligent edge can be imbued with mixed reality and artificial intelligence to move us beyond the 2D worlds of the PC and smartphone, and into mixed reality and the third wave of computing.

To help catalyse this third wave of computing, we are expanding our Mixed Reality Developer Program. Over the past year, we have engaged with more than 20,000 mixed reality developers, a number we expect to more than triple in the coming 12 months. To serve the needs of a larger audience, we are investing in more meetups, programs, events and hacks with an increased focus on serving the mixed reality dev community on a global scale.

HoloLens 2 Development Edition

We are also hoping to inspire the mixed reality developers of the future. To support devs on this journey, we’re excited to bring you HoloLens 2 Development Edition.

HoloLens 2 offers the most comfortable and immersive mixed reality experience available, with industry-leading solutions that deliver value in minutes- all backed by the reliability, security, and scalability of cloud and AI services from Microsoft. The HoloLens 2 Development Edition is designed to help developers build mixed reality apps and experiences, jump-starting your mixed reality plans with an offer that combines HoloLens 2 with free trials of Unity software and Azure credits for cloud services.

For more information, check out the Development Edition page.

Unreal Engine 4 Native HoloLens Integration

Last, but not least, we are excited to announce Unreal Engine 4’s native integration with HoloLens 2. It is now easier than ever to create really high quality 3D experiences for HoloLens 2. We are really excited about this partnership and the creativity it will unlock in mixed reality, much as it has done in gaming.

What next?

Interested in developing with HoloLens 2, but don’t know where to start? At Build 2019 there were some fantastic sessions that covered many areas of HoloLens 2 development, from basic introductions to the device and which tools to use, to in-depth explorations of Unity and Unreal. If you’ve already started out on your Mixed Reality journey and just want some advice, why not try the From the Trenches talk? It features a wealth of tips and tricks from other Mixed Reality developers.

• MR 101: An Introduction to Mixed Reality
• Modeling the world for Mixed-Reality
• Mixed Reality and Unreal
• Intro to Building Mixed Reality Apps with Unreal Engine 4
• Intro to Building Apps for HoloLens 2 Using Unity and Mixed Reality Toolkit
• HoloLens 2 Display: The Bigger Picture
• From the Trenches – Tips & Tricks from experienced MR developers
• Developing Mobile Augmented Reality (AR) Applications with Azure Spatial Anchors
• Azure Digital Twins + HoloLens: Powering the Next Generation of IoT

Learn more

• Mixed Reality documentation on Microsoft Docs
• All on-demand sessions from Build 2019
• The official HoloLens 2 website

The post HoloLens 2: Build announcements and on-demand sessions appeared first on Microsoft Industry Blogs - United Kingdom.

In my role I have the privilege to work with NHS Trusts on the cutting edge of digital transformation, so I regularly get to see the inspiring and, quite frankly, mind-blowing use cases of how our devices are being used. Although I live this day in, day out, the excitement about what is possible never really goes away. I’m aware that many nurses and doctors in the NHS may have never heard about some of this, so today I bring you the HoloLens and Surface Go. If this blog doesn’t completely blow your mind, just have a think about what AI brings to the equation!

Microsoft HoloLens and Surface Go are being used with incredible impact in the NHS. From reading vitals remotely through a camera, to enabling remote collaboration for first line workers.

HoloLens in surgery

Microsoft first shipped Kinect eight years ago. This was the first AI device with speech and vision. We then took that technology forward with Microsoft HoloLens. HoloLens is the first self-contained, holographic computer, enabling you to engage with your digital content and interact with holograms in the world around you. Just working with the HoloLens team for healthcare at Microsoft has pushed me up the ‘cool ratings’ as a mum! When first introduced, it was never imagined how quickly this would take off in healthcare and the wide implications it would have.

Surgeons at Alder Hey – one of the largest children’s hospitals in the UK – will use HoloLens to view patient information while they’re operating on them. Rafael Guerrero, cardiac surgeon at Alder Hey, said Microsoft HoloLens would enable surgeons to have a patient’s scans in front of them and allow them to view medical images and notes while performing an operation, without using their hands.

“Imaging a patient’s heart from the inside and outside is absolutely essential. I have to visualise that 3D view in my head in order to do this operation. You can display those images on a screen in the operating theatre sometimes, but it’s not easily accessible and I can’t leave in the middle of an operation to get more information about my patient. In many cases, the heart has already stopped in order for us to operate. If I can use technology to obtain that information, to see those images in front of me, that helps me tremendously and improves the outcome for my patient.”

– Rafael Guerrero, cardiac surgeon at Alder Hey

Using HoloLens to ‘look inside’ patients prior to surgery

In a similar use case, surgeons at Imperial College Healthcare NHS Trust have been using Microsoft HoloLens to ‘look inside’ patients prior to operating on them.

The latest announcement brought the new app that will help empower first line workers – the first workers to interface with customers and triage problems: Microsoft Remote Assist. Microsoft Remote Assist enables remote collaboration via hands-free video calling, letting first line workers share what they see with any expert on Microsoft Teams, while staying hands-on to solve problems and complete tasks together. When I first wore HoloLens and made a call using the app to a colleague, the immediate use cases filled my head! Paramedics and first responders could very easily communicate hands-free with specialist consultants whilst at the scene, and get emergency advice and triage, with the specialist clinician seeing through the eyes of the paramedic and being able to interact. It’s very hard to explain on a written page when the technology involves holographic images, but you can see it in action here.

A Surface Go solution to read vitals remotely

Next, we have some amazing use cases for AI on the Surface Go.

A new Microsoft partner called LifeLight is providing a solution that delivers incredible medical grade vital signs, such as blood pressure, in a few seconds from a selfie camera on a mobile device. In my role at Microsoft, I’m excited by the projects I hear about on a daily basis, but when I saw this in action, it rendered me speechless for the first time. I stood completely free of any wires or human contact, looked into a Surface Go, and the app read my vital signs. The potential of this solution really is endless.

If used as triage into acute care, the solution could save time by taking vital signs on entry. If used alongside telehealth solutions, vitals could be seen live during a Skype consultation for example, as well as wellness and self-management apps, and tracking.

Microsoft partner, GPC, has a fantastic solution for wound care showcasing the power of AI solutions using a RealSense camera and Surface Go. In the UK, the NHS spends £5.3 billion on patients on an annual basis, and £1 billion per year on patients with post-operative wounds. Measuring the wounds is often subjective, and classification on their severity can often be incorrect. The solution captures 3D wound images on the consultant’s laptop, tablet, or smartphone, and can then accurately and automatically measure essential wound dimensions including depth and surface area. This allows you to see changes in wound size and structure remotely, and securely, whilst being able to share with specialists to view and remeasure.

The idea of holograms in surgery is no longer restricted to the realms of science fiction. I’m genuinely so excited to see how far this technology can go, and how much it can empower our nurses, doctors, and front line workers.

Learn more

Maximising the AI opportunity

About the author

Kelly is the Healthcare Industry Manager at Microsoft UK, working with transformational digital partners and NHS customers to pilot solutions for collaborative working and empowering everyone to do more. She has 15 years’ experience working alongside the NHS, and is passionate about the power technology has to create positive change in healthcare.

The post AI in healthcare: HoloLens in surgery appeared first on Microsoft Industry Blogs - United Kingdom.