System and method for generating a depth map and fusing images from a camera array

摘要

A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

主权项

1. A method comprising:
obtaining a plurality image pixels from at least one image sensor, wherein the plurality of image pixels comprises:
a first image of a first color,a second image of the same first color,a third image of a second color, anda fourth image of a third color; constructing a first disparity map using the plurality of image pixels by calculating pixel disparities between the first image and the second image via mono-chromatic stereo matching, the first disparity map being associated with a first direction; constructing a second disparity map, the second disparity map being associated with a second direction; warping the third image, along the second direction using the second disparity map, to create a corrected third image; warping the fourth image, along the first direction using the first disparity map and along the second direction using the second disparity map, to create a corrected fourth image; and combining the first image, the corrected third image, and the corrected fourth image to create a fused multi-channel color image.