Different-view image generating apparatus and different-view image generating method

摘要

An apparatus includes: a generating unit which generates, from each of images respectively obtained at viewpoint positions, one of different-viewpoint images which corresponds to an image at a virtual viewpoint position different from the viewpoint positions, the different-viewpoint image including a hole area in which a pixel value is missing; a calculating unit which calculates, for each of processing units respectively in predetermined areas in the different-viewpoint images, a hole density indicating, with respect to the predetermined area, a ratio of one of the hole areas in the processing units in the different-viewpoint images; a calculating unit which calculates, for each processing unit, a combination ratio of the different-viewpoint image, based on the hole density of the processing unit co-located with an other one of the processing units in an other one of the different-viewpoint images; and a combining unit which combines the different-viewpoint images, based on the combination ratios.

主权项

1. A different-viewpoint image generating apparatus comprising:
a processor; and a non-transitory computer-readable medium having stored thereon executable instructions that, when executed by the processor, cause the different-viewpoint image generating apparatus to function as: a different-viewpoint image generating unit configured to generate, from each of two or more images respectively obtained at two or more viewpoint positions, one of two or more different-viewpoint images which correspond to an image obtainable at a virtual viewpoint position different from the two or more viewpoint positions, based on distance information indicating a depth of a pixel in one of the two or more images, the one of the two or more different-viewpoint images including a hole area in which a pixel value is missing; a hole density calculating unit configured to calculate, for each of processing units respectively in predetermined areas in the two or more different-viewpoint images, a hole density indicating, with respect to the predetermined area, a ratio of one of the hole areas in the processing units in the two or more different-viewpoint images, the processing unit being made up of one or more pixels; a combination ratio calculating unit configured to calculate, for each of the processing units, a combination ratio of one of the two or more different-viewpoint images, based on the hole density of the processing unit which is co-located with an other one of the processing units in an other one of the two or more different-viewpoint images; and a different-viewpoint image combining unit configured to combine the two or more different-viewpoint images, based on the combination ratios of the processing units, wherein the hole density calculating unit is configured to calculate, as a plurality of the hole densities of the co-located processing units in the two or more different-viewpoint images, a plurality of the ratios of the hole areas in windows which are the predetermined areas having the co-located processing units as centers of the predetermined areas, and wherein the hole density calculating unit is configured to calculate a plurality of the hole densities by assigning different weights to a hole area located at a central part of the window and a hole area located at a peripheral part of the window.