First Metaverse experiment?See what’s happening in medicine

Surgeon Shafi Ahmed poses for a photo wearing a Microsoft HoloLens headset in the operating room of The Royal London Hospital on Thursday, January 11, 2018.

Bloomberg | Bloomberg | Getty Images

Metaverse, the next big thing in the digital world, is touted as an internet domain where our physical animated avatars can interact with virtually any kind of interaction, from shopping to games to travel. I am. Wonks states that it can take more than a decade for the required technology to catch up with the hype.

However, the healthcare industry now utilizes some of the key components that ultimately make up the Metaverse. Virtual reality (VR), augmented reality (AR), mixed reality (MR), artificial intelligence (AI), etc. It also includes software and hardware to enhance your application. For example, medical device companies use MRs to assemble surgical instruments and design operating rooms, the World Health Organization (WHO) uses ARs and smartphones to train Covid-19 responders, and psychiatrists use VR. It is used to treat post-traumatic stress (PTS) among combat soldiers, and the medical department is using VR for surgical training.

Facebook, Oculus, Covid

Since Facebook — Now Meta platform — In 2014, we acquired Oculus and its VR headset technology for $ 2 billion, and numerous healthcare applications have been developed. One of the latest was a collaboration between Facebook Reality Labs and Nexus Studios and WHO Academy. The organization’s R & D incubator has designed a mobile learning app for healthcare professionals fighting Covid-19 around the world. One of the training courses includes AR that simulates the proper technique and sequence for putting on and taking off a person’s protective equipment on a smartphone. With content available in seven languages, the app builds on the needs expressed by the 22,000 global health workers surveyed by WHO last year.

Oculus technology is used to train orthopedic residents at UConn Health, a medical center at the University of Connecticut in Farmington, Connecticut. Educators are teaming up with PrecisionOS, a Canadian medical software company that provides VR training and education modules for orthopedics. By wearing the Oculus Quest headset, residents can visualize in 3D various surgical procedures, such as pinning a fractured bone. Because the steps are virtual, the system allows students to make mistakes, receive feedback from faculty, and incorporate them into their next attempt.

Meanwhile, the Metaverse is still under construction, so “I think it’s a great opportunity to continue the work that Meta is already doing to support its health efforts,” a Metaverse spokeswoman said. increase. “As the meta experience, apps and services evolve, we can expect health strategies to play a role, but it’s too early to say how it intersects with third-party technologies and providers.”

when Microsoft In 2016, we announced the HoloLens AR smart glasses for commercial development. striker, A medical technology company in Kalamazoo, Michigan. In 2017, we began using AR devices to improve the process of designing operating rooms in hospitals and surgical centers. ORs are shared by a variety of surgical services, from general surgery to orthopedics to the heart, so lighting, equipment, and surgical tools vary from procedure to procedure.

Stryker engineers can recognize the opportunities HoloLens 2 offers in the evolution of OR design from 2D to 3D and use holograms to design shared ORs. The MR experience visualizes everyone, equipment, and setup without the need for physical objects or people.

Zimmer Biomet, a medical device company based in Warsaw, Indiana, recently announced the OptiVu Mixed Reality Solutions platform with HoloLens devices and three applications. A third that allows clinicians to share their MR experiences with patients after surgery and before surgery.

“We are currently using HoloLens in a pilot fashion with remote assist in the US, EMEA and Australia,” said a Zimmer Biomet spokeswoman. The technology is being used in remote case coverage and training programs, and a spokeswoman said the company is developing software applications on HoloLens as part of a data solution focused before and after the procedure.

Microsoft’s future holographic vision

In a hands-on application of AR medical technology, a Johns Hopkins neurosurgeon performed AR surgery on a living patient for the first time in the facility in June. In the first procedure, the doctor placed six screws on the patient’s spine during spinal fusion. Two days later, another team of surgeons resected the cancerous tumor from the patient’s spine. Both teams wore headsets from Israeli company Augmedics with a see-through eye display that projected images of the patient’s internal structures such as bones and other tissues based on CT scans. “It’s like having a GPS navigator in front of you,” said Timothy Witham, MD, director of the Johns Hopkins Neurosurgery Spinal Fusion Institute.

At the Miller School of Medicine at the University of Miami, Gordon Center instructors for simulation and innovation in medical education use AR, VR, and MR to perform strokes, heart attacks, or gunshot wounds. Students practice life-saving heart surgery in Harvey, a life-like mannequin that realistically simulates almost any heart disease. Wearing a VR headset allows students to “see” the underlying anatomy that is graphically exposed in Harvey.

“In a digital environment, we are not tied to physical objects,” said Barry Issenberg, MD, professor of medicine and director of the Gordon Center. Before developing a virtual technology curriculum, he said, students need to be in the field and train real trauma patients. “We can now guarantee that all learners have the same virtual experience, regardless of geographic location.”

The University of Southern California Creative Technology Institute (ICT) has been developing VR, AI, and other technologies to address a variety of medical and mental health conditions since it was founded in 1999. “The technology when I first got involved was in the Stone Age,” said Albert “Skip” Rizzo, a psychologist and director of ICT’s medical virtual reality, tinkering with Apple IIe and Game Boy handheld game consoles. I remembered what I did. Currently he is using Oculus’s VR and AR headsets. HP And Magic Leap.

Reso has helped create a VR exposure therapy called Bravemind, aimed at providing relief from PTS, especially among veterans of the war in Iraq and Afghanistan. During exposure therapy, a trained therapist-guided patient confronts his or her traumatic memory through a simulation of their experience. Wearing a headset allows you to immerse your patients in a variety of virtual scenarios, such as Middle East-themed urban and desert road environments.

“Patients use the keyboard to simulate people, rebels, explosions, and even odors and vibrations,” says Rizzo. And instead of focusing on imagining a particular scenario, patients can experience it in a secure virtual world as an alternative to traditional speech therapy. Evidence-based Bravemind therapy is currently available in more than 12 Department of Veterans Affairs hospitals and has been shown to significantly reduce PTS symptoms. Additional randomized controlled trials are underway.

Big Tech continues to build a metaverse with software and hardware companies, academia, and other R & D partners, so the healthcare industry continues to be a real-life test site. “The Metaverse is still in its infancy, but it has great potential for transforming and improving healthcare,” wrote Paulo Pinheiro, Software Head of Sagentia Innovation, based in Cambridge, UK, on ​​the Advisory Farm website. increase. “It’s fascinating to see the situation unfold.”

Stay connected with Healthy Returns

For seats in the front row of the CNBC event, seeKeynote Podcast.. ” Listen nowHowever, podcasts are available.

For more exclusive insights from reporters and speakers, Sign up for us Healthy Returns Newsletter We deliver the latest ones directly to your inbox every week.

First Metaverse experiment?See what’s happening in medicine

Source link First Metaverse experiment?See what’s happening in medicine

Back to top button