High-resolution image generation apparatus, high-resolution image generation method, and high-resolution image generation program

摘要

It is an object to obtain a high-resolution image generation apparatus that can generate a high-quality image by sorting out good portions from faulty portions in optical flow. The present invention includes: a hard disk that stores multi-viewpoint image information and parameter information of a base image and a plurality of reference images; an optical flow computation unit that extracts a plurality of pairs of the base image and a reference image, the plurality of pairs each including a different reference image, and computes optical flow for each pair; a depth information computation unit that computes depth information which indicates depth of each pixel of the base image for each pair, based on optical flow and the parameter information; and an optical flow sorting unit that determines whether or not each piece of pixel-based correspondence information included in the optical flow of each pair is to be used for improving a resolution of the base image, based on two pieces of the depth information.

主权项

1. A high-resolution image generation apparatus that performs on an image a process to improve a resolution of the image to a higher resolution, the high-resolution image generation apparatus comprising:
an image storage unit to store a subject image whose resolution is to be improved and a plurality of reference images obtained by capturing an imaging subject of the subject image from viewpoints different from a viewpoint of the subject image, and store imaging device condition information which indicates an imaging condition of an imaging device when each of the subject image and the plurality of reference images is captured, in association with a corresponding one of the subject image and the plurality of reference images; an optical flow computation unit to extract a plurality of pairs including the subject image and one of the plurality of reference images from the image storage unit, the plurality of pairs each including a different one of the plurality of reference images, and compute, with a processing device, optical flow including pixel-based correspondence information which indicates a pixel of the one of the plurality of reference images corresponding to each pixel of the subject image, for each of the plurality of pairs extracted; a depth information computation unit to compute depth information which indicates depth of each pixel of the subject image for each of the plurality of pairs, based on the optical flow of each pair computed by the optical flow computation unit and the imaging device condition information corresponding to each of the subject image and the one of the plurality of reference images included in said pair, out of the imaging device condition information stored in the image storage unit; and an optical flow determination unit to determine, with the processing device, whether or not each piece of the pixel-based correspondence information included in the optical flow of each pair is to be used for improving the resolution of the subject image, based on at least two pieces of the depth information out of the depth information computed by the depth information computation unit.