System and method for exploiting scene graph information in construction of an encoded video sequence

摘要

A system method and computer program product for creating a composited video frame sequence for an application. A current scene graph state for the application is compared to a previous scene graph state wherein each scene graph state includes a plurality of hierarchical nodes that represent one or more objects at each node. A video construction engine determines if one or more objects have moved based upon a comparison of the scene graph states. If one or more objects have moved based upon the scene graph comparison, motion information about the objects is determined and the motion information is forwarded to a stitcher module. The motion information is used to define motion vectors for use by the stitcher module in construction of the composited video frame sequence.

主权项

1. A method for creating a composited video frame sequence, the method comprising:
at a system including one or more processors and memory storing instructions for execution by the processor: comparing a current scene graph state with a previous scene graph state, wherein the current scene graph state and the previous scene graph state are respective states of a tree data structure that includes a plurality of hierarchical nodes associated with one or more objects within a graphical scene and that includes spatial information for the one or more objects representing respective positions of the one or more objects in the graphical scene,
wherein the comparing comprises comparing, for at least some of the one or more objects, the spatial information of the current scene graph state with the spatial information of the previous scene graph state; determining if at least one object of the one or more objects has moved based upon the comparison of the scene graph states; in accordance with a determination that at least one object of the one or more objects has moved, determining motion information about the at least one object based on the comparison of the scene graph states; and defining motion vectors for the composited video frame sequence based on the motion information.