Multi-layer encoding and decoding

摘要

Innovations described herein provide a generic encoding and decoding framework that includes some features of simulcast and some features of scalable video coding. For example, a bitstream multiplexer multiplexes component bitstreams into a multi-layer encoding (MLE) bitstream that provides temporal scalability, spatial resolution scalability and/or signal to noise ratio scalability. Each of the component bitstreams provides an alternative version of input video, and a given component bitstream can be a non-scalable bitstream or scalable bitstream. The multiplexer follows composition rules for the MLE bitstream and may rewrite values of certain syntax elements of component bitstreams using an approach that avoids bit shifting operations. A corresponding demultiplexer receives an MLE bitstream that includes component bitstreams and demultiplexes at least part of at least one of the component bitstreams from the MLE bitstream, following decomposition rules for the demultiplexing.

主权项

1. In a computing system that implements a bitstream multiplexer, a method comprising:
with the computing system that implements the bitstream multiplexer, multiplexing multiple component bitstreams into a multi-layer encoding (MLE) bitstream, wherein:
each of the multiple component bitstreams provides an alternative version of input video, each of the multiple component bitstreams being independently decodable to reconstruct its version of the input video;each of the multiple component bitstreams is a non-scalable bitstream having a single layer or a scalable bitstream having a base layer and at least one enhancement layer;values of picture parameter set identifiers are set to avoid conflicting uses of the values of the picture parameter set identifiers between the multiple component bitstreams in the MLE bitstream, such that each of the values of the picture parameter set identifiers is unique across the multiple component bitstreams, each of the picture parameter set identifiers identifying a picture parameter set; andthe multiplexing includes inserting marker data units in the MLE bitstream, wherein each of the marker data units includes a priority identifier and one or more quality layer identifiers, the priority identifier associating a video data unit with a given layer of one of the multiple component bitstreams; and outputting the MLE bitstream.