Image processing device, image processing method, image capturing device, and program

摘要

An image processing device for generating a composite image using multi-viewpoint image data before color interpolation captured by a camera array image capturing device, includes a unit configured to acquire information of a pixel value and a pixel position in the multi-viewpoint image data, a pixel position determination unit configured to determine the pixel position in the composite image in the pixel position of each pixel of the multi-viewpoint image data in accordance with an arbitrary focus position based on optical parameters at the time of the image capturing, a color derivation unit configured to derive the color of each pixel of the multi-viewpoint image data, and a pixel value calculation unit configured to calculate the pixel value of each pixel of the composite image using the determined pixel position in the composite image and the pixel value of the multi-viewpoint image data corresponding to the derived pixel color.

主权项

1. An image processing device comprising:
an obtaining unit configured to obtain a plurality of color images each of which is captured, from a viewpoint different from each other, through a color filter array comprising a plurality of color filters corresponding to a plurality of colors, wherein each pixel of the plurality of color images misses information of at least one of the plurality of colors; and a generating unit configured to generate, by combining the plurality of color images before performing an interpolation for the missing color information, and by performing an interpolation for color information on a combined image which is a result of the combination of the plurality of color images, a composite image which corresponds to an arbitrary focus position and comprises at least one pixel having information of all of the plurality of colors, wherein the combined image includes at least one missing pixel having information of at least one of the plurality of colors and missing color information of at least one of the plurality of colors, and the generating unit performs interpolation for the missing color information on the missing pixel.