System and method for exploiting scene graph information in construction of an encoded video sequence

摘要

A system method and computer program product for creating a composited video frame sequence for an application. A current scene state for the application is compared to a previous scene state wherein each scene state includes a plurality of objects. A video construction engine determines if properties of one or more objects have changed based upon a comparison of the scene states. If properties of one or more objects have changed based upon the comparison, the delta between the object's states is determined and this information is used by a fragment encoding module if the fragment has not been encoded before. The information is used to define, for example, the motion vectors for use by the fragment encoding module in construction of the fragments to be used by the stitching module to build the composited video frame sequence.

主权项

1. A method for creating a composited video frame sequence, comprising:
at a system including one or more processors and memory storing instructions for execution by the processor:
comparing a current scene state with a previous scene state, wherein the current scene state includes a first plurality of objects having respective properties, and wherein the previous scene state includes a second plurality of objects having respective properties;detecting a difference between the respective properties of the first plurality of objects and the respective properties of the second plurality of objects;in accordance with the difference between the respective properties being detected, retrieving one or more pre-encoded first video fragments based on the detected difference, wherein each of the one or more pre-encoded first video fragments is a portion of a full frame of video; andcompositing the video frame sequence, wherein the video frame sequence includes at least one of the one or more pre-encoded first video fragments.