Methods and systems for visualization of 3D parametric data during 2D imaging

摘要

Methods and systems for visualization of 3D parametric data in a 2D image. The set of 3D parametric data includes a plurality of voxels in 3D space each associated with at least one parametric value, and the set of 2D image data includes information about a known camera position and a known camera orientation at which the 2D image was obtained. A graphical representation is generated of the parametric values of the voxels corresponding to a viewing surface in 3D space. A virtual 2D view of the viewing surface is determined. The 2D image is displayed registered with the graphical representation of the parametric values of the voxels corresponding to the virtual 2D view.

主权项

1. A method for visualization of 3D parametric data in a 2D image of a non-planar surface, the method comprising:
receiving first signals representing 3D surface data representing a non-planar 3D surface of a physical object to be visualized; receiving second signals representing a set of 3D parametric data, the 3D parametric data being distinct from the 3D surface data representing the 3D surface of the physical object to be visualized, the set of 3D parametric data including a plurality of voxels in 3D space each associated with at least one parametric value; spatially registering the 3D surface data representing the 3D surface of the physical object to be visualized and the 3D parametric data, the registered 3D surface having a plurality of surface elements; receiving third signals representing a set of 2D image data representing the 2D image, the set of 2D image data including information about a known camera position and a known camera orientation at which the 2D image was obtained; identifying voxels of the set of 3D parametric data corresponding to a set of surface elements of the plurality of surface elements of the 3D surface of the physical object to be visualized, the identifying based at least partly on the spatial registration of the 3D surface data representing the 3D surface of the physical object to be visualized and the 3D parametric data; generating a graphical representation of the parametric values of the voxels of the set of 3D parametric data corresponding to the set of surface elements of the 3D surface of the physical object to be visualized by, for each surface element in the set of surface elements, assigning a parametric value of the parametric values based on one or more voxels being closest to the respective surface element, and generating a visual representation based on the assigned parametric value; determining a virtual 2D view of the 3D surface of the physical object to be visualized, the virtual 2D view corresponding to the known camera position and the known camera orientation of the 2D image; modifying the virtual 2D view with the graphical representation of the parametric values corresponding to the virtual 2D view of the 3D surface of the physical object to be visualized by combining the obtained 2D image with at least a part of the virtual 2D view to produce a combined 2D image by at least one of overlaying and underlaying the graphical representation of the parametric values with the obtained 2D image, the obtained 2D image and the graphical representation of the parametric values being visible in the combined 2D image based on the visual representations; and providing signals for displaying the combined 2D image.