System and method for object based parametric video coding

摘要

A video compression framework based on parametric object and background compression is proposed. At the encoder, an embodiment detects objects and segments frames into regions corresponding to the foreground object and the background. The object and the background are individually encoded using separate parametric coding techniques. While the object is encoded using the projection coefficients to the orthonormal basis of the learnt subspace (used for appearance based object tracking), the background is characterized using an auto-regressive (AR) process model. An advantage of the proposed schemes is that the decoder structure allows for simultaneous reconstruction of object and background, thus making it amenable to the new multi-thread/multi-processor architectures.

主权项

1. A digital video decoder, comprising:
a decoding block configured to decode background I frames and edge blocks of background P-frames in an encoded video sequence; an object appearance estimator configured to estimate an object appearance based on object appearance parameters in the encoded video sequence; a texture synthesizer coupled to the decoding block and configured to generate background P blocks based on auto regressive coefficients and thread information in the encoded video sequence and the decoded edge blocks; and a frame compositor coupled to the decoding block, the object appearance estimator and the texture synthesizer and configured to generate a composite output frame based on outputs of the decoding block, the texture synthesizer and the object appearance estimator.