University of Maryland School of Medicine Helps Launch New Center to Accelerate Advancement of Virtual Reality into Patient Care

The University of Maryland School of Medicine (UMSOM) is the joint recipient of $4.75 million in funding from the National Science Foundation to establish a new Center for Medical Innovations in Extended Reality. The Center, known as MIXR, will help accelerate the development of virtual reality, augmented reality, and other immersive media technologies – referred to as “extended reality”—for use in clinical trials and eventually widespread use in medical care.

UMSOM faculty are partnering with University of Maryland College Park (UMCP) computer scientists and engineers and University of Michigan physician-scientists to establish MIXR. They will also receive expertise and funding from Google, Microsoft, Meta (formerly known as Facebook), among others to develop, test, and certify extended reality technologies for use in medicine and health care.

“Immersive technologies have the potential to fundamentally change, improve and reduce the cost of medical training and maintaining clinical skills across all aspects of health care,” said Sarah Murthi, MD, Associate Professor of Surgery at UMSOM who is co-investigator on this project. She is an attending physician at the R Adams Cowley Shock Trauma Center and Director of the Critical Care Ultrasound Program. “They also have the huge potential to improve patient care, in everything from how pain is managed to how procedures are performed.”

Dr. Murthi plans to continue working to understand how extended reality can fundamentally change medicine. She is focusing on using these tools in education and training and to help improve the patient experience in those who are critically ill. She is also working to implement innovative extended reality medical displays that could improve how bedside procedures are done. She helped develop and test an augmented reality prototype that overlays ultrasound, CT and video data directly on the patient.

Collaborators on these projects include Adam C. Puche, PhD, Professor and Vice Chair Dept of Anatomy & Neurobiology at UMSOM, who is working on virtual reality technologies for surgical education and training, and Nicholas Morris, MD,  Assistant Professor of Neurology at UMSOM and Luana Colloca, MD, PhD, who are both investigating the use of virtual reality programs for pain management in critically ill patients.

The initial work started in the Maryland Blended Reality Center (MBRC) which Dr. Murthi launched in 2017 with Amitabh Varshney, PhD, Professor and Dean of the College of Computer, Mathematical, and Natural Sciences at UMCP. Dr. Varshney serves as the lead-site principal investigator on the MIXR project.

“The synergy in MIXR will be contagious,” Dr. Varshney said. “Our industry partners will push forward new ideas and novel technologies. The scientists and physicians will help refine and test those ideas. And we both will work with the Food and Drug Administration (FDA) to bring these technologies from the lab to the proper health care setting where they can have an exponential impact.”

Dr. Varshney and his colleagues at UMCP will soon unveil a “HoloCamera” studio, where more than 300 immersive cameras are fused together, creating a unique 3-D visualization technology. The aim is to create a holographic type of image to assist in the training of health care practitioners conducting intricate medical procedures.

In 2018, Murthi and Varshney co-authored an op-ed in the Harvard Business Review that detailed how augmented reality could improve patient care and lower costs in hospital settings. They also teamed up with the Maryland Institute College of Art to test a virtual reality platform that can help patients deal with physical and emotional trauma through immersion in another world with a focus on quadriplegic patients who are hospitalized with acute spinal cord injury.

Dr. Murthi also plans to continue her collaboration with Toby Guerin, Associate Director for the Center for Dispute Resolution at UMB Carey Law School on developing virtual reality interventions to improve empathy and understanding between police and community members as an innovative form of violence reduction.

The award is part of NSF’s Industry-University Cooperative Research Centers (IUCRC) program, designed to jumpstart breakthrough research by enabling close and sustained engagement between industry innovators, world-class academic teams and government agencies.

Behrooz Shirazi, acting deputy division director of the NSF’s Division of Computer and Network Systems and a program director for IUCRC, called MIXR one of the first national centers at the intersection of medical and computing sciences. “We expect this vibrant collaboration to produce significant societal and health care impacts,” he said.

In addition to Google, Microsoft and Meta, other technology companies involved in MIXR are Sony, Magic Leap, Health2047, GigXR, Brainlab and apoQlar.

Another key partner in the MIXR initiative will be regulatory experts at the FDA, who will provide input and review of the new technologies to ensure that they are safe and effective for patient use. 

“We are so grateful to NSF for their support of this important collaboration. Together with our colleagues in academia, industry and government, we can advance state of the art medical technologies and provide faster benefits to patients,” said Dean E. Albert Reece, MD, PhD, MBA, Executive Vice President for Medical Affairs, UM Baltimore, and the John Z. and Akiko K. Bowers Distinguished Professor and Dean, University of Maryland School of Medicine.

About the University of Maryland School of Medicine

Now in its third century, the University of Maryland School of Medicine was chartered in 1807 as the first public medical school in the United States. It continues today as one of the fastest growing, top-tier biomedical research enterprises in the world — with 46 academic departments, centers, institutes, and programs, and a faculty of more than 3,000 physicians, scientists, and allied health professionals, including members of the National Academy of Medicine and the National Academy of Sciences, and a distinguished two-time winner of the Albert E. Lasker Award in Medical Research.  With an operating budget of more than $1.2 billion, the School of Medicine works closely in partnership with the University of Maryland Medical Center and Medical System to provide research-intensive, academic and clinically based care for nearly 2 million patients each year. The School of Medicine has nearly $600 million in extramural funding, with most of its academic departments highly ranked among all medical schools in the nation in research funding.  As one of the seven professional schools that make up the University of Maryland, Baltimore campus, the School of Medicine has a total population of nearly 9,000 faculty and staff, including 2,500 students, trainees, residents, and fellows. The combined School of Medicine and Medical System (“University of Maryland Medicine”) has an annual budget of over $6 billion and an economic impact of nearly $20 billion on the state and local community. The School of Medicine, which ranks as the 8th highest among public medical schools in research productivity (according to the Association of American Medical Colleges profile) is an innovator in translational medicine, with 606 active patents and 52 start-up companies.  In the latest U.S. News & World Report ranking of the Best Medical Schools, published in 2021, the UM School of Medicine is ranked #9 among the 92 public medical schools in the U.S., and in the top 15 percent (#27) of all 192 public and private U.S. medical schools.  The School of Medicine works locally, nationally, and globally, with research and treatment facilities in 36 countries around the world. Visit medschool.umaryland.edu