Video retargeting using content-dependent scaling vectors

摘要

Techniques are disclosed for retargeting images. The techniques include receiving one or more input images, computing a two-dimensional saliency map based on the input images in order to determine one or more visually important features associated with the input images, projecting the saliency map horizontally and vertically to create at least one of a horizontal and vertical saliency profile, and scaling at least one of the horizontal and vertical saliency profiles. The techniques further include creating an output image based on the scaled saliency profiles. Low saliency areas are scaled non-uniformly while high saliency areas are scaled uniformly. Temporal stability is achieved by filtering the horizontal resampling pattern and the vertical resampling pattern over time. Image retargeting is achieved with greater efficiency and lower compute power, resulting in a retargeting architecture that may be implemented in a circuit suitable for mobile applications such as mobile phones and tablet computers.

主权项

1. A computer-implemented method for retargeting an input image, the computer-implemented method comprising:
receiving the input image comprising a plurality of pixels; computing a two-dimensional saliency map based on at least a portion of the input image; projecting the two-dimensional saliency map in at least one of a first direction to create a horizontal saliency profile and a second direction to create a vertical saliency profile; scaling at least one of the horizontal saliency profile and the vertical saliency profile non-linearly to create at least one of a scaled horizontal saliency profile and a scaled vertical saliency profile; computing a two-dimensional resampling grid based on at least one of the scaled horizontal saliency profile and the scaled vertical saliency profile; and creating an output image based on the two-dimensional resampling grid.