| 摘要 |
User interface virtualization describes a technique for providing a user with access to one computing device from another computing device, while translating the ergonomics of one computer's user interface style into the ergonomics of the other's. An agent running on a remote desktop exchanges metadata and input events with a corresponding client running on a client device that accepts a “touch and swipe” style input. The agent running on the remote desktop may use an interface interaction API or software framework to programmatically manipulate the user interface of the remote desktop and act as a proxy for the corresponding client. The client constructs and displays native graphical user interface elements at the client device that are virtual representations of a corresponding user interface element at the remote desktop, including file dialogs, clipboards, start menus, and task switchers. |
| 主权项 |
1. A method of generating a local graphical user interface (GUI) on a touch screen of a client device that is connected to a server device having a remote desktop, the method comprising:
receiving, from the server device, user interface (UI) metadata that specifies content of a GUI element in the remote desktop, and a base image comprising a graphical representation of the remote desktop; generating, at the client device, a native GUI element based on received UI metadata, wherein the native GUI element comprises a virtual representation of a corresponding GUI element of the remote desktop, wherein the native GUI element includes a copy of content shown in an application within the remote desktop, wherein the copy of continent is provided by the received UI metadata; generating a local GUI to be displayed on the touch screen of the client device, the local GUI comprising the base image received from the server device and the native GUI element rendered on top of the base image; and responsive to detecting that the native GUI element has been manipulated through a touch input, modifying a selection region of the native GUI element that indicates a selected portion of the copy of content by using touch input to resize the selection region, and transmitting, to the server device, an input event indicating a manipulation of the corresponding GUI element in the remote GUI by the client device, the input event indicating a selection of a corresponding portion of the content shown in the application within the remote desktop, the input event also indicating a clipboard operation at the remote desktop based on a local selection of the copy of content, as specified by the selection region. |
