The advanced simulators I have produced are an integration of real and virtual worlds. Featured in this portfolio are two examples: 1) the Injection Simulator and 2) the MIS (Minimally Invasive Surgery) trainer simulator.

The INJECTION SIMULATOR used a physical model with a corresponding internal anatomy (which was a 3D animation model that was medically accurate) that was replicated in a virtual world. Using a customized tracking system, the location of the physical injector and its penetration of the model was mirrored exactly in the virtual anatomy visible on screen.  A  control interface allowed users to focus on specific anatomical elements, with feedback on targeting accuracy.

The development of the production model of the Injection Simulator was preceded by the development of a prototype. The prototype not only provided proof-of-concept for the entire simulator system, but also yielded valuable information about optimization of engineering, interface and programming elements.  Most importantly, the prototype provided an opportunity for physicians to use the simulator and provide feedback key to the success of the next stage of development.

MIS TRAINER SIMULATOR

The da Vinci Surgical System is a robotic system with a 3D high definition camera and display for Minimally Invasive Surgery (MIS). Surgeons can operate through a few small incisions, using a system that translates the surgeon’s hand movements into the smaller, precise movements of tiny instruments. However, MIS requires training in both the manipulation of probes and the ability to work in 3D space.

A two-part exhibit was created to show an example of real world stereoscopic 3D digital video and a trainer that was used to learn hand/eye coordination in remote probe manipulation.

The simulator for the exhibit used at its core an actual training system which was adapted for use as a game, with head-to-head competition and a leader board.  This system was so popular that physicians would return to increase their scores and see their names climb on the leaderboard.  In addition, the Virtual Surgery Challenge was used for 3 consecutive years.