Automatic discovery and mirroring of server-client remote user interface (RUI) session on a companion device and synchronously controlling both sessions using RUI on companion device

摘要

A server sends to a video device such as a TV a remote user interface (RUI) that is presented on the TV and manipulable to send control commands back to the server. A companion device such as a tablet computer discovers the RUI session and is provided by the server with its own RUI, which mirrors that on the TV, modified as appropriate for the screen of the companion device. The server maintains the two RUIs synchronized such that the RUI on the companion mirrors the RUI on the TV.

主权项

1. A device comprising:
at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor of a companion device to an audio video display device (AVDD) to: receive from a server information pertaining to rendering a remote user interface (RUI), a version of which is presented on the AVDD, display locations on the RUI presented on the companion device being selectable by a user to send information correlatable to control commands for the AVDD to cause the AVDD to execute respective functions, a control command generated using the RUI on the companion device causes execution of at least one of: change a source of video for presentation of the video on the AVDD, change volume output by the AVDD, perform a trick play function on the AVDD, record a video presented on the AVDD; and receive from the server updates to the RUI such that the RUI presented on the companion device is synchronized with the version presented on the AVDD, wherein the instructions are executable to receive, from the server, the information pertaining to rendering the RUI in a low level graphics card protocol via a transmission control protocol/Internet Protocol (TCP/IP) socket, the information pertaining to rendering the RUI defining how to render RUI elements of the RUI but not defining functionality of the RUI elements, such that selection of an RUI element causes sending a signal back to the server indicating a screen location at which the selection occurred, which the server then correlates to the appropriate function underlying the selected RUI element.