Array Camera Configurations Incorporating Constituent Array Cameras and Constituent Cameras

摘要

Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.

主权项

1. An array camera configuration, comprising:
a constituent array camera comprising a plurality of cameras, where each camera comprises: optics that form an image on a focal plane defined by an array of pixels that capture image data; and have fields of view that form a combined field of view in a first viewing direction; a separate camera comprising: optics that form an image on a focal plane defined by an array of pixels that capture image data; and having a field of view in a second viewing direction; a processor; memory containing an image processing application and calibrated warp data; wherein the image processing application directs the processor to:
obtain image data from the cameras in the constituent array camera;capture an image using the separate camera from a viewpoint;generate a depth map using the image data captured by the constituent array camera;synthesize an image using the image data captured by the constituent array camera and the depth map; andconstruct an enhanced image using the image captured by the separate camera, the synthesized image, and the depth map used to synthesize the synthesized image by:
warping the synthesized image into the viewpoint of the image captured by the separate camera using the calibrated warp data and the depth map; andblending the synthesized image warped into the viewpoint of the image captured by the separate camera and the image captured by the separate camera to create the enhanced image.