Recap of our Healthcare online session with Yale University School of Medicine

During our weekly online sessions, our community (both the end-users and solution providers) share their expertise and experiences. Participants introduce themselves and their companies.

During our Healthcare meet this week, the guest speaker was from Yale University, Randall Rode, and he discussed the challenges of scaling virtual reality (VR) technologies on campus, emphasizing the need to address hardware dependencies and practical integration. He also highlighted the use of VR and Microsoft HoloLens in simulation labs, including solving limited faculty resources and involving art students in creating interactive projects. Challenges in implementing VR technology were discussed, such as faculty engagement and strategic planning. The meeting also touched on different modalities to solve problems, the multi-platform approach, incorporating XR into nursing education, current technology implementation, haptics and VR capabilities, patient education using immersive tech, XR and Gen AI for patient simulation, and the challenges of scaling AR and VR in medicine. Concerns were raised about the usage of HoloLenses, and the decision was made to conduct follow-up workshops and encourage faculty integration.

Topics & Highlights

1. Introductions

  • Participants introduced themselves and provided information about their companies and areas of focus.

2. Presenting Guest Speaker

  • Alex Dzyuba introduced Randall Rode as the guest speaker, providing information about his role and expertise at Yale University.

3. Scaling Virtual Reality Technologies

  • Participants discussed the challenges of scaling virtual reality technologies on campus and the need to address hardware dependencies and practical integration.

4. Using VR and HoloLens in Simulation Labs

  • The speaker mentions that none of the students in the simulation lab think they need VR and haptic gloves.

  • The speaker gives an example of using Microsoft HoloLens with Azure guides to solve the problem of limited faculty resources and time in teaching basic skills.

  • The speaker discusses the importance of finding ways to empower student and faculty creators, such as allowing faculty to create their own content and involving art students in creating interactive projects using CT brain scans.

  • The speaker emphasizes the need for social interaction and accessibility in educational VR solutions, as well as the importance of actively connecting different sections of the campus and overcoming silos.

5. Challenges in Implementing VR Technology

  • The speaker expresses concerns about faculty engagement and the difficulty of getting them to try new technology.

  • The speaker discusses the need to determine who will own the VR technology and the importance of strategic planning.

  • The speaker outlines the five aspects to consider when scaling VR technology: technology, content, institutional culture, implementation and system operations, and financial considerations.

  • The speaker mentions the peer work they have done and the successful implementation of an XR application in the School of Medicine.

6. Discussion about different modalities to solve a problem

  • Participants mentioned that considering it's 25 year old technology, it would have solved the problem. He questioned the fairness of claiming that virtual reality or standard reality can solve the problem. He also questioned the feasibility of a mobile internet version of the same thing.

  • Participants mentioned that getting people in the headset is the best way to sell it, but offering other options is crucial. He proposed a continuum of experiences and the need for alternatives for all audiences.

  • Participants asked if these other modalities can solve the problem and questioned the applicability of the technology.

  • Participants responded that it's not an either-or situation and suggested a continuum of experiences with different levels of convenience and fidelity.

7. Discussion about using multi-platform approach

  • Participants asked about using MDM and the multi-platform approach. Randall Rode mentioned looking at HoloLens and Intune for managing the devices. He discussed the need to make decisions regarding deploying quest headsets and providing alternatives for users.

  • Multiple speakers discussed the multi-platform approach for consumers of the technology, focusing on managing the devices and providing different experiences.

8. Discussion about incorporating XR into nursing education

  • Participants shared his background and experience with exploring XR in nursing education. He mentioned the challenges faced, including the weight of devices and the desire for smart glasses. He questioned whether XR is the primary solution for replacing standardized patients or mannequins.

  • Participants expressed concerns about the current limitations of XR technology and raised questions about its effectiveness as a primary solution.

9. Discussion about current technology and its implementation

  • The speaker emphasizes the importance of using technology that works today and not waiting for future advancements.

  • The speaker discusses the need to find ways to fit technology into the organization's culture and gain faculty support.

  • The speaker mentions the AV team as potential advocates for implementing new technology.

10. Discussion on haptics and VR capabilities

  • Participants mentioned the importance of having the right tools for specific tasks, such as haptics, and the potential future development of haptic capabilities through XR glasses.

  • Participants emphasized the importance of plug and play compatibility of adaptive tools in different facilities.

  • Randall Rode discussed the benefits of VR for practicing procedures without the need for haptics, especially for overwhelming experiences in simulation labs or clinical situations.

  • Participants shared a research paper that showed the effectiveness of VR in training medical students for surgical procedures and highlighted the importance of learning proper sequences in various fields.

  • Participants expressed enthusiasm for educators exploring the strengths and shortcomings of VR as a medium for learning in different domains.

11. Patient Education and Immersive Tech

  • Participants discusses her work on creating a content creation management and deployment solution for patient education using immersive tech.

  • Randall Rode mentions some early explorations at his institution around patient education and leveraging immersive tech, including support groups in VR.

  • Participants shares his unique perspective as a medical student and VR researcher, discussing the potential of VR simulations for medical education, particularly in emergency scenarios like codes.

12. XR and Gen AI for patient simulation

  • Participants mentions other companies using Gen AI for patient simulation.

  • Participants discusses the ability to modify scenarios on the backend, including medication, allergies, medical history, and voice intonation.

  • Participants and others discuss the potential of XR and Gen AI for exams, patient education, and visualizing viruses and pathogens.

13. Challenges of scaling AR and VR in medicine

  • Participants raises concerns about the challenges of scaling AR and VR in medicine, including determining appropriate use cases and getting clinicians engaged.

14. HoloLenses Usage

  • The team plans to conduct follow-up workshops and encourage faculty to integrate HoloLenses into the curriculum.