RECEIVER-SIDE MODIFICATIONS FOR REDUCED VIDEO LATENCY

摘要

A host has a graphics pipeline that process frames by portions (e.g., pixels or rows) or slices. A remote device transmits a video stream container via a network to the host. A frame of the video stream in the container has encoded portions. The graphics pipeline includes a demultiplexer that extracts the portions of the video frame. When a portion has been extracted it is passed to a decoder, which is next in the pipeline. The decoder may begin decoding the portion before receiving a next portion of the frame, possibly while the demultiplexer is demultiplexing the next portion of the frame. A decoded portion of the frame is passed to a renderer which accumulates the portions of the frame and renders the frame. At any time portions of a frame might concurrently be being received, demultiplexed, decoded, and rendered. The decoder may be single-threaded, multi-threaded, or hardware accelerated.

主权项

1. A computing device comprising:
processing hardware, storage hardware, and a network interface configured to receive packets containing multimedia container portions comprising encoded slices of a video frame, the packets received via a network from a host that encoded the encoded slices and that generated the container portions; a demultiplexer configured to demultiplex the encoded slices of the video frame from the container portions; and a decoder configured to receive and decompress the encoded slices of the video frame from the demultliplexer, wherein the decoder receives a demultiplexed encoded slice of the video frame from the demultiplexer before another encoded slice of the video frame has been demultiplexed by the demultiplexer.