Gian Dion Dubberke

Let's talk

Medical - VR - Unity

Star Shift Medical
VR Shockroom Star

Topic

A Workshop demo project to showcase how to develop a VR Project in medicine

ShiftMedical gmbh is a Heidelberg based Company with the focus on Medical XR. With an inhouse XR lab and strong conections to the Heidelberg clinic.

Congress
LinkedIn

Goal

Show common development steps to support a 5-lesson workshop program.

The application was built with common XR interactions, state-of-the-art interactive virtual patients, real-time data manipulation and spatial sound design for clinical training scenarios.

Year

2023

Responsibilities

Full Workshop
Concept
Blockout
Coordination
Development
Interactions

Patners

Lars Wiesenkopsieker
Markus Kühner

Process

The Story

I was given the opportunity to lead the development of a new section for the Shift Medical Congress, specifically focused on providing medical professionals with a hands-on, in-depth look at the VR development cycle. The goal was to bridge the gap between cutting-edge VR technology and its real-world applications in healthcare. To achieve this, I conceptualized a dynamic workshop where our team of three developers would work alongside experts from each stage of the VR development process. Together, we would walk the audience through every step, from the initial idea to a fully functional prototype. The focus was on creating an immersive VR experience simulating an emergency room scenario, which would serve as the foundation for the event sessions.

The Challenges

The complexity of the project was daunting, especially given the tight timeline of just three weeks for the entire development cycle. Coordinating between various specialists—each with their own area of expertise—required a high level of organization and communication. Developing a prototype that was not only functional but also realistic and engaging for medical professionals was no small task. We needed to incorporate a range of interactive elements, such as realistic movement mechanics, AI-powered voice interactions, and dynamic soundscapes. This was further complicated by the fact that the prototype had to remain flexible enough for live demonstrations, while also showcasing innovative solutions in VR development on a small scale.

Overcoming the Challenges

Despite the challenges, the project became a success thanks to a collaborative approach and a focus on transparency. We embraced an iterative development process, refining each stage of the prototype based on team feedback and user testing. The workshop’s format—an open dialogue between developers and medical experts—was crucial in creating a deeper understanding of VR’s potential in healthcare. The final product was a fully interactive, emergency room-based VR experience that combined various movement types, AI interactions, and realistic sound elements. The two-day event was co-hosted by over nine professionals, and the overwhelmingly positive audience response confirmed that our efforts had paid off. The workshop quickly became the highlight of the Shift Medical Congress, cementing its place as a standout experience in the event’s history.

All Source code falls under NDA

All Projects