Adaptive encoder-assisted frame rate up conversion

摘要

Adaptive video encoding and decoding methods and apparatuses for encoder-assisted frame rate up-conversion (EA-FRUC) are described herein. An encoder selectively encodes at least a portion of a video frame, such as a block, using an interpolated FRUC frame as a reference. The encoder interpolates at least a portion of the FRUC frame at the same time instance as the yet to be encoded video frame, and selects one of a plurality of FRUC encoding modes for that portion, e.g., based on rate distortion (RD). The encoder encodes the frame using the selected FRUC encoding mode, the FRUC reference frame, and any additional reference frames that may be indicated. A decoder interpolates the FRUC frame and uses it for decoding with knowledge of the particular FRUC mode that was used by the encoder. The encoder communicates the FRUC mode for a block via one or more existing parameters in the encoded video frame.

主权项

1. A digital video encoding method comprising:
interpolating, using a processor, a frame rate up-conversion (FRUC) video frame; selecting one of a plurality of FRUC modes for encoding at least a portion of an encoded video frame, wherein each FRUC mode of the plurality of FRUC modes is associated with encoding different types of motion compensation information; encoding, using the processor, the at least a portion of the video frame based on the selected FRUC mode and using the FRUC frame as a reference; adjusting, using the processor, one or more parameters for the at least a portion of the encoded video frame to indicate the selected FRUC mode; and generating a bitstream that includes the encoded video frame, wherein the bitstream does not include the FRUC frame.