Telestration and Augmented Reality in Minimally Invasive Surgery

Telestration systems are instructional tools that enable freehand drawing (annotation) or guidance via display of hands or other structures over images or videos.

Surgical instruction telestration systems are now available for laparoscopic and robotic-assisted surgery and can overlay virtual hand movements and gestures or painting and drawing of resection lines as an augmented or mixed reality overlay for simulated training or in real-time during procedures.

This video illustrates telestration instruction of surgical technique with an augmented reality overlay of the instructor’s hands on the operative screen using the iSurgeon system (Heidelberg University Hospital).

Click the Related Article link for a full discussion of use of the technology for remote proctoring and telementoring of surgical trainees and faculty and the Related Multimedia link for illustration of instruction using the AIS TeleSurgeon system (AIS Channel), a plug-and-play device that does not require additional equipment other than a personal computer or tablet.