Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information

摘要

Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.

主权项

1. An array camera, comprising:
a processor; and a memory connected to the processor and configured to store an image processing application; wherein the image processing application configures the processor to:
obtain image data, wherein:
the image data comprises a set of images comprising a reference image and at least one alternate view image; andeach image in the set of images comprises a set of pixels;generate a depth map based on the image data, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image by performing a parallax detection process to generate the depth map, where the parallax detection process identifies variations in the position of objects within the image data along epipolar lines between the reference image and the at least one alternate view image;determine at least one prediction image based on the reference image and the depth map, where the prediction images correspond to at least one alternate view image;compute prediction error data based on the at least one prediction image and the at least one alternate view image, where a portion of prediction error data describes the difference in photometric information between a pixel in a prediction image and a pixel in at least one alternate view image corresponding to the prediction image; andgenerate compressed light field representation data based on the reference image, the prediction error data, and the depth map.