Augmented stereoscopic visualization for a surgical robot using a camera unit with a modified prism

摘要

An endoscope with a stereoscopic optical channel is held and positioned by a robotic surgical system. A first capture unit captures: a visible first color component of a visible left image combined with a fluorescence left image from first light from one channel in the endoscope; a visible second color component of the visible left image from the first light; and a visible third color component of the visible left image from the first light. A second capture unit captures: a visible first color component of a visible right image combined with a fluorescence right image from second light from the other channel in the endoscope; a visible second color component of the visible right image from the second light; and a visible third color component of the visible right image from the second light. An augmented stereoscopic outputs a real-time stereoscopic image including a three-dimensional presentation including the visible left and right images and the fluorescence left and right images.

主权项

1. A method comprising:
capturing a left stereoscopic tissue image and a right stereoscopic tissue image,
wherein the left and right stereoscopic tissue images each comprise light in a first visible color component wavelength range, light in a second visible color component wavelength range, light in a third visible color component wavelength range, and light in a fluorescence component wavelength range, andwherein the fluorescence component wavelength range is substantially different from the first, second, and third visible color component wavelength ranges; sensing the captured left image by a first prismatic element directing substantially only light in the first visible color component wavelength range and light in the fluorescence component wavelength range to a first sensor, directing substantially only light in the second visible color component wavelength range to a second sensor, and directing substantially only light in the third visible color component wavelength range to a third sensor, wherein the sensed first visible color component wavelength range is separated and removed from the sensed fluorescence component wavelength range; and sensing the captured right image by a second prismatic element directing substantially only light in the first visible color component wavelength range and light in the fluorescence component wavelength range to a fourth sensor, directing substantially only light in the second visible color component wavelength range to a fifth sensor, and directing substantially only light in the third visible color component wavelength range to a sixth sensor, wherein the sensed first visible color component wavelength range is separated and removed from the sensed fluorescence component wavelength range.