Image enhancement using self-examples and external examples

摘要

Systems and methods are provided for image enhancement using self-examples in combination with external examples. In one embodiment, an image manipulation application receives an input image patch of an input image. The image manipulation application determines a first weight for an enhancement operation using self-examples and a second weight for an enhancement operation using external examples. The image manipulation application generates a first interim output image patch by applying the enhancement operation using self-examples to the input image patch and a second interim output image patch by applying the enhancement operation using external examples to the input image patch. The image manipulation application generates an output image patch by combining the first and second interim output image patches as modified using the first and second weights.

主权项

1. A method comprising:
receiving an input image patch of an input image; identifying an up-sampled image patch matching the input image patch, wherein the up-sampled image patch is included in an up-sampled version of the input image; determining a smoothness or texture for an image region of the up-sampled version of the input image in which the up-sampled image patch is identified, wherein determining the smoothness or texture comprises processing the image region of the up-sampled version of the input image and outputting the smoothness or texture from the processing; determining, based on the determined smoothness or texture, a first weight for a first enhancement operation using self-examples and a second weight for a second enhancement operation using external examples; generating a first interim output image patch by applying the first enhancement operation to the input image patch and a second interim output image patch by applying the second enhancement operation to the input image patch; and generating an output image patch by combining the first interim output image patch modified using the first weight and the second interim output image patch modified using the second weight.