George Washington University Hospital has partnered with Novarad to implement augmented reality in surgery.
Novarad’s OpenSight Augmented Reality System renders 2D, 3D and 4D images of patients interactively and overlays the images directly onto a patient’s body. It is powered by Microsoft HoloLens. The technology was designed to visualize 3D imaging holograms of a patient, on the patient, for pre-operative localization and surgical planning, according to the company.
The 3D holograms are created using a refractory system in the device in combination with the Microsoft HoloLens hardware and OpenSight technology.
“OpenSight allows the surgeon to overlay the medical image onto the patient’s body, so not only do I see the patient laying on top of the table, but I can see the CT hologram,” professor of surgery and emergency medicine at GWU Babak Sarani said in a press release. “Us having this technology meets the endpoint of our mission as an academic hospital.”
The headset features an infrared camera that has ranging and localizing technology to map surrounding areas, including the patient. It can pick up where objects are and create mesh surface maps to implement 3D positioning. The system then places visual tracking tags on the patient that follows as the surgeon moves. Imaging capabilities include virtual incisions, shunts, needle placement and more.
“A revolution in surgery is beginning and George Washington University is leading the charge,” co-creator Wendell Gibby said. “Using the OpenSight augmented reality device from Novarad, doctors can literally see the patient and see into them at the same time. High resolution advanced holographic imaging is merged in 3D onto the patient with optical precision. This transformative technology promises to improve outcomes in a world of more precise medicine.”
A teaching version of the software is available to allow medical students to perform virtual dissections on cadavers.
“Novarad’s unique OpenSight system uses the Microsoft HoloLens headset and augments real-world health care environments with virtual 3D patient images, and we are very pleased that they have achieved FDA medical clearance for pre-surgical use of their OpenSight solutions for HoloLens,” senior director of marking for Microsoft HoloLens Matt Fleckenstein said. “It’s exciting to see George Washington University Hospital become the first medical team to adopt this new system – empowering its doctors with the technology to improve surgical outcomes.”