Split frame multistream encode

摘要

Presented herein are techniques for creating video for participants in a video conference. A designated primary video stream is decoded and the resulting video composed in accordance with a primary sub-picture portion of a frame. Other video streams are designated as secondary video streams output by secondary entities, and are decoded and composed in accordance with a secondary sub-picture portion of the frame structured for the secondary entities. The composed primary video stream is encoded for display at each secondary entity, to obtain encoded slices of a primary video stream. The composed secondary video stream is encoded for display at one of the secondary entities, to obtain encoded slices of a secondary video stream. The encoded primary and secondary video streams are combined at the encoded slice level into a single video stream for transmission to, and decode and display at, the one of the secondary entities.

主权项

1. A method, comprising:
outputting, to a plurality of video conference participants, at least one encoded video frame that includes a first portion of the video frame and a second portion of the video frame, in which the first portion of the video frame contains the same video data for the plurality of video conference participants as encoded by a shared encoder, and in which the second portion of the video frame is uniquely encoded by a plurality of non-shared encoders for each of the respective video conference participants; receiving a video receive error indication from at least one of the plurality of video conference participants; and in response to the received video receive error indication, instructing the shared encoder and the plurality of non-shared encoders to perform resynchronization, wherein the resynchronization is performed irrespective of whether the video receive error indication is due to an error in the first portion or in the second portion of the video frame.