CONCURRENT DECOMPRESSION OF MULTIPLE VIDEO STREAMS WITH CONSTRAINED DECOMPRESSION RESOURCES

摘要

A method and system for gracefully reducing demands for shared decompression resources required to present multiple video streams concurrently such that their streaming video content is simultaneously available for further processing or display. In particular, it relates to the use of presentation time stamps for incoming frames with reference to a time base clock and a threshold to determine if the decompression resources are falling behind in their ability to process incoming frames in real time. If this occurs then frames are dropped, i.e. discarded without being decompressed, with preference given to dropping incremental frames rather than key frames.

主权项

1. A method of gracefully reducing demands for shared decompression resources required to present more than eight video streams concurrently, the method including:
receiving a first key frame in a first video stream for decompression by a first decompression processor; obtaining a first presentation time stamp, abbreviated PTS, for the first key frame, benchmarking the first PTS against a time base clock to obtain a benchmark reference value, and decompressing the first key frame, wherein:
the presentation time stamp gives a presentation time at which a frame is to be presented or displayed; andreceiving additional frames in the first video stream; obtaining additional PTSs for at least some subsequent additional frames; when a particular additional PTS for a particular additional frame, as compared to the time base clock and the benchmark reference value, indicates that the first decompression processor has fallen behind a presentation time, by more than a threshold, at which the particular additional frame should be presented, responsively initiating dropping of incremental frames in the first video stream at least until receipt of a second key frame; and decompressing at least some incremental frames that are not dropped.