Systems and Methods for Cloud Processing and Overlaying of Content on Streaming Video Frames of Remotely Processed Applications

摘要

A first application executes on one or more computing systems to generate a series of original frame pixel data sets for rendering of graphical images associated with the first application execution. A second application executes on one or more computing systems to detect one or more key graphical images present in the series of original frame pixel data sets. Upon detection of the one or more key graphical images, the second application directs replacement of a portion of pixel data in the series of original frame pixel data sets with substitute pixel data so as to generate a series of modified frame pixel data sets for encoding in lieu of the series of original frame pixel data sets.

主权项

1. A system for augmenting a remotely served computer application, comprising:
a frame augmentation module configured to intercept a pixel data set of a display frame image generated by a remotely served computer application executing on a first computing system for transmission over a network for display by a second computing system, the frame augmentation module configured to identify a target portion of the pixel data set of the display frame image as intercepted by the frame augmentation module, the target portion of the pixel data set corresponding to visual content to be modified in the display frame image, the frame augmentation module configured to generate a revised pixel data set for the display frame image in which the target portion of the pixel data set is modified, the frame augmentation module configured to provide the revised pixel data set for transmission over the network for display by the second computing system in place of the pixel data set of the display frame image as intercepted by the frame augmentation module, wherein the frame augmentation module is configured separate from the remotely served computer application executing on the first computing system, such that the remotely served computer application executing on the first computing system is not involved in operations of the frame augmentation module including interception of the pixel data set of the display frame image, identification of the target portion of the pixel data set, generation of the revised pixel data set, and provision of the revised pixel data set for transmission over the network in place of the pixel data as intercepted.