Surgical procedure capture, modelling, and editing interactive playback

摘要

A system for generating surgical procedure training media draws upon the realistic data of an actual surgical procedure for realistic training without the risks. A 3D capturing component records three-dimensional model plus imaging data over time of a portion of a patient's body undergoing a surgical procedure. A spatial detection system detects an orientation of a surgical instrument relative to the patient's body during the surgical procedure. A modeling component creates a four-dimensional model (3D model+time) of the portion of the patient's body. Animation such as contingent events, trainee prompts, a virtual surgical instrument, etc., can be added to the model to expand upon the training potential. A user interface processes and edits training media for playback of the four-dimensional model including defining triggers responsive to a trainee simulated surgical inputs to pace sequencing of playback. An interactive player responds to pacing the playback of the editing training media or to a spatially detected simulated surgical instrument held by the student for direct tissue interaction.

主权项

1. A method for generating training media, comprising:
capturing three-dimensional data over time of a portion of a human patient's body undergoing a surgical procedure, the capturing being performed at least in part by stereoscopic video cameras or by a three-dimensional camera; recording physiological readings over time of the portion of the human patient's body, the physiological readings comprise at least a movement cycle; capturing visual imagery of an exposed portion of the human patient's body; creating, using one or more processors, a four-dimensional model of the portion of the human patient's body based on the three-dimensional data, the physiological readings, and the visual imagery of the exposed portion of the human patient's body changing over time; and modifying at least a portion of the three-dimensional data or visual imagery of the human patient's body to maintain privacy of the human patient's body.