High-quality upscaling of an image sequence

摘要

A method, system, and computer-readable storage medium are disclosed for upscaling an image sequence. An upsampled frame is generated based on an original frame in an original image sequence comprising a plurality of frames. A smoothed image sequence is generated based on the original image sequence. A plurality of patches are determined in the upsampled frame. Each patch comprises a subset of image data in the upsampled frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames in the smoothed image sequence. A plurality of high-frequency patches are generated. Each high-frequency patch is based on image data at the locations of the corresponding patches in the original image sequence. The plurality of high-frequency patches are added to the upsampled frame to generate a high-quality upscaled frame.

主权项

1. A computer-implemented method, comprising:
denoising an original image sequence to generate a denoised image sequence; generating an upsampled frame based on a denoised frame in the denoised image sequence, the original image sequence comprising a plurality of frames; generating a smoothed image sequence based on the denoised image sequence; determining a plurality of patches in the upsampled frame that is based on the denoised frame, each of the plurality of patches comprising a subset of image data in the upsampled frame; determining locations of a plurality of corresponding patches in a neighboring set of the plurality of frames in the smoothed image sequence that is based on the denoised image sequence, the neighboring set of the plurality of frames being determined from frames within a threshold number of frames before or after the upsampled frame; generating a plurality of high-frequency patches, each high-frequency patch being based on image data at the locations of the plurality of corresponding patches in the original image sequence, the locations derived from the corresponding patches in the denoised image sequence; and adding the plurality of high-frequency patches to the upsampled frame.