Systems and Methods for Dynamic Refocusing of High Resolution Images Generated Using Images Captured by a Plurality of Imagers

摘要

Systems and methods in accordance with embodiments of the invention are disclosed that use super-resolution (SR) processes to use information from a plurality of low resolution (LR) images captured by an array camera to produce a synthesized higher resolution image. One embodiment includes obtaining input images determining an initial estimate of at least a portion of a high resolution image using a plurality of pixels from the input images, and determining a high resolution image that when mapped through the forward imaging transformation matches the input images to within at least one predetermined criterion using the initial estimate of at least a portion of the high resolution image. In addition, each forward imaging transformation corresponds to the manner in which each imager generates the input images, and the high resolution image has a resolution that is greater than any of the input images.

主权项

1. A method of generating a high resolution image of a scene using an imager array including a plurality of imagers that each capture an image of the scene, and a forward imaging transformation for each imager, the method comprising:
obtaining input images captured by a plurality of imagers using a processor configured by image processing pipeline software; determining an initial estimate of at least a portion of a high resolution image from a plurality of pixels from the input images using the processor configured by the image processing pipeline software; determining a high resolution image that when mapped through a forward imaging transformation matches the input images to within at least one predetermined criterion using the processor configured using the image processing pipeline software based upon the initial estimate of at least a portion of the high resolution image, where:
each forward imaging transformation corresponds to the manner in which each imager in the plurality of imagers captures the input images; andthe high resolution image has a resolution that is greater than any of the input images; and generating a depth map for the high resolution image using a processor configured by image processing pipeline software; determining a focus map for the high resolution image using the depth map using a processor configured by image processing pipeline software; and performing dynamic refocus of the high-resolution image using a processor configured by image processing pipeline software by rendering the high resolution image using the focus map.