SYSTEM AND METHOD FOR ADAPTIVE DEPTH MAP RECONSTRUCTION

摘要

What is disclosed is a system and method for adaptively reconstructing a depth map of a scene. In one embodiment, upon receiving a mask identifying a region of interest (ROI), a processor changes either a spatial attribute of a pattern of source light projected on the scene by a light modulator which projects an undistorted pattern of light with known spatio-temporal attributes on the scene, or changes an operative resolution of a depth map reconstruction module. A sensing device detects the reflected pattern of light. A depth map of the scene is generated by the depth map reconstruction module by establishing correspondences between spatial attributes in the detected pattern and spatial attributes of the projected undistorted pattern and triangulating the correspondences to characterize differences therebetween. The depth map is such that a spatial resolution in the ROI is higher relative to a spatial resolution of locations not within the ROI.

主权项

1. A method for adaptive depth map reconstruction comprising:
receiving a mask identifying at least one region of interest (ROI) in a scene; using a multi-camera array to acquire images of said scene, said multi-camera array comprising at least two imaging devices with overlapping fields of view such that salient features in said scene are simultaneously imaged by said at least two imaging devices; and reconstructing, by a depth map reconstruction module, a depth map of said scene from said acquired images, said reconstructing comprising:
establishing correspondences between said salient features;changing a density of said established correspondences by adjusting a selectivity threshold that determines a degree of saliency required for a feature to be considered salient such that said density is higher at locations corresponding to said ROI, as identified by said mask;determining offsets between said established correspondences;triangulating said offsets to obtain depth values; andaggregating said depth values to reconstruct said depth map, said reconstructed depth map being such that a spatial resolution in said ROI is higher relative to a spatial resolution of scene locations not associated with said ROI.