Image stabilization using striped output transformation unit

摘要

An image signal processor of a device, apparatus, or computing system that includes a camera capable of capturing video clips may be configured to apply non-warping and warping transformations (including image stabilization transformations) to image data received from the camera's image sensor. The transformations may be applied piecewise to pixels of the image data gathered into multiple line buffers. The line buffers may be divided into vertical slices, each of which may be processed in parallel by a respective portion of the image signal processor circuitry (or circuitry of an output rescaling unit thereof). The image signal processor may not write the received image data to system memory until after the transformations have been performed. By leveraging existing filters and scalers of the image signal processor, rather than a CPU or GPU, image stabilization may be provided that consumes half of the bandwidth and power consumed by existing techniques.

主权项

1. An apparatus, comprising:
a camera sensor; an image signal processor; and a system memory; wherein the image signal processor is configured to:
receive data representing an image from the camera sensor;divide the received image data into a pre-determined number of horizontal lines of pixels and a plurality of vertical stripes of pixels each comprising a pre-determined portion of the horizontal lines of pixels;determine motion in a sequence of images that includes the image represented by the received data;perform one or more non-warping image transformations and one or more warping image transformations on the received data to produce modified image data, wherein the warping image transformations are dependent on the determined motion;wherein to perform the one or more non-warping image transformations and the one or more warping image transformations, the image signal process is further configured to: apply at least some of the non-warping image transformations or the warping image transformations in a piecewise manner to the horizontal lines of pixels or the vertical stripes of pixels; andsubsequent to performing the non-warping and warping image transformations, provide the modified image data to the system memory.