Using augmented reality (AR) in first year medical education
AR at Columbia University, Vagelos College of Physicians and Surgeons (P&S)
Joanna (Jo) Weeks is a fourth-year medical student working with Brooklyn based AR start-up Medivis. They use AR to teach first-year medical students the complex 3D relationships which provide the foundation for human anatomy and physiology.
How does the partnership work? Students gain exposure to AR, have an opportunity to use 3D, and find collaborators. Medivis considers exposing 1st year medical students to AR an altruistic endeavor which not only supplements the medical school’s rigorous curriculum, but, will add to the legacy of AR in medicine. It not only adds value to the students’ practical education with dependable, moldable models, it offers an environment away from the classroom. While AR will not replace cadavers, it is a viable means to educate.
For one project, Medivis used 2 Microsoft HoloLenses and their own Anatomy X software. 15 P&S students reviewed curriculum-specific modules and posted quizzes and feedback. The plusses? Advisorship, sponsorship, and direct student involvement through feedback.
AR was introduced to CUMC. Anatomy X still in development so there are limitations. Students offered positive feedback stating AR is a great supplement to classes, immersive, and engaging.
Creating MR from the ground up with SphereGen
Ashley Barbuito, Ted Dinsmore, and Ron Burgess from SphereGen demonstrated Mixed Reality Devices such as the HoloLens with non-holographic/immersive head mounted display. Its applications include:
- Immersive fire preparedness training with a MR Smoke out, ideal for fire safety training
- An art gallery
- DICOM Director, which assists radiologists viewing DICOM data
- AI Engineering – applications include such feats as bridge construction
- Columbia dental
- Asset Creation
- Maya, ZBrush, 3DS Max, Blender
- Pre-existing models include: Unity, CGtrader, Turbo Split, GrabCad
- Optimizing assets - Simplygon, Arvizio, create quality textures