Systems and methods for generating a composite video based on a plurality of video streams using a frame schedular

摘要

A system for video compositing is comprised of a storage device for storing a composite timeline file. A timeline manager reads rendering instructions and compositing instructions from the stored file. A plurality of filter graphs, each receiving one of a plurality of video streams, renders frames therefrom in response to the rendering instructions. 3D hardware is responsive to the rendered frames and the compositing instructions for creating a composite image. A frame scheduler is responsive to the plurality of filter graphs for controlling the frequency at which the 3D hardware creates a new composite image. An output is provided for displaying the composite image. Methods of generating a composite work and methods of generating the timeline file are also disclosed. Because of the rules governing abstracts, this Abstract should not be used to construe the claims.

主权项

1. A system for video compositing, comprising:
a storage device for storing a composite timeline file; a timeline manager responsive to said stored timeline file for reading rendering instructions and compositing instructions, wherein the timeline file identifies a particular period of time when data from a first video stream and data from a second video stream are to be displayed simultaneously; a plurality of filter graphs, each for receiving one of a plurality of video streams and for rendering frames therefrom in response to said rendering instructions, wherein each filter graph transmits a frame ready signal when that filter graph renders a new frame, wherein the filter graphs include a first filter graph associated with the first video stream and a second filter graph associated with the second video stream; 3D hardware responsive to said rendered frames and said compositing instructions for creating a composite image; and a frame scheduler responsive to said plurality of filter graphs for controlling the frequency at which said 3D hardware creates a new composite image, wherein, during the particular period, the frame scheduler is configured to command the 3D hardware to create a new composite image whenever the first filter graph or the second filter graph transmits a frame ready signal.