System and method for selecting a video encoding format based on feedback data

摘要

A computer-implemented system and method for performing video compression are described. For example, a method according to one embodiment comprises: encoding a plurality of video frames or portions thereof according to a first encoding format; transmitting the plurality of encoded video frames or portions to a client device; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames or portions has been successfully received and/or decoded; in response to detecting that one or more video frames or portions thereof have not been successfully received and/or decoded, determining a number of video frames or portions thereof which have not been successfully received and/or decoded and: (1) if the number of video frames or portions thereof which have not been successfully received and/or decoded is above a specified threshold, then encoding a new video frame or portion thereof according to a second encoding format, the second encoding format comprising a format which is not dependent on previously-transmitted video frames or portions thereof; or (2) if the number of video frames or portions thereof which have not been successfully received and/or decoded is below a specified threshold, then encoding a new video frame or portion thereof according to the first encoding format, the new video frame encoded to be dependent on a last known successfully received video frame or portion thereof; and transmitting the new video frame or portion thereof to the client device.

主权项

1. A computer-implemented method for low-latency video game or application hosting and video compression comprising:
receiving control signals in a first hosting service center, the control signals being received from a client device in response to an input device of the client device being actuated by a user as the user is playing the low latency video game or using the application, the control signals being transmitted from the client device to the first hosting service center over one or more networks; executing a video game or application on one or more servers at the first hosting service center in response to the control signals received from the client device as the user plays the video game or uses the application; generating video of the executed video game or application by the one or more servers, the video comprising a plurality of video frames; encoding the plurality of video frames of the video stream to generate a low-latency encoded video stream; transmitting the low-latency encoded video stream to the client device over the one or more networks for decoding and displaying the decoded video stream on the client device; wherein the operations of receiving the control signals, executing the video game or application, generating video, encoding the plurality of video frames, and transmitting the low-latency encoded video stream over the one or more networks to the client device, and decoding and displaying the video on the client device are performed with a latency such that the user of the client device has the perception that the video game or application is responding instantly; receiving feedback information from the client device, the feedback information usable to determine whether data contained in the video frames has been successfully received and decoded at the client device; modifying the encoding of the plurality of video frames in response to detecting that one or more video frames have not been successfully received and decoded at the client device; wherein encoding the plurality of video frames of the video stream to generate the low-latency encoded video stream further includes encoding the plurality of video frames of the video stream to generate the low-latency encoded video stream and generate a second encoded video stream having a quality independent of the feedback information received from the client device and directing the second encoded video stream to a buffer within the first hosting service center and wherein the second encoded video stream has a first scaling factor wherein the first scaling factor is a full resolution of the video stream.