Skipped video data recovery using multiple alternative recovery modes

摘要

In some embodiments, a video decoder is capable of recovering skipped video data (e.g. motion vectors, prediction modes, quantization parameters, selected frequency-domain coefficients such as DC and 5-lowest-frequency AC coefficients, and/or entire video data blocks) using multiple alternative recovery modes such as spatial interpolation, temporal interpolation, and motion search. To decide whether to skip a particular data type for a block, the encoder evaluates the effect of skipping the data on rate and distortion by simulating the decoder data recovery using the multiple recovery modes. The encoder transmits indicators of skipped data types and associated recovery modes, if different from decoder baselines. The skipped data and recovery mode indicators may be included in macroblock and/or slice headers, and/or as part of sequence, group-of-picture (GOP), or picture coding parameter data. Skipped data recovery decoder resources (e.g. motion search logic) may be used for recovering data lost due to transmission errors.

主权项

1. A video encoding method comprising:
receiving a sequence of video frames, each frame comprising a plurality of non-overlapping rectangular blocks; encoding the sequence of video frames to generate an encoded video data set for each of the plurality of non-overlapping rectangular blocks included in the video frames, wherein the encoded video data set comprises a block encoding mode, a motion vector, a quantization parameter, and a set of frequency domain coefficients for each image block; determining, on a block-by-block basis, a decoding consequence of skipping transmission to a decoder of a target subset of the encoded data set for each image block by analyzing a predicted recovery of the target subset by the decoder according to a plurality of alternative decoder recovery modes, wherein the target subset includes at least one block-level parameter set in the encoded data set; and deciding, on a block-by-block basis, whether to skip transmission of the target subset to the decoder according to the decoding consequence of skipping transmission of the target subset to the decoder.