Systems and methods for interacting with mobile devices using external displays

摘要

A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.

主权项

1. A method for interacting with a mobile device using an external display, the method comprising:
sending representation data from a mobile device to a host system; sending a code corresponding to each representation of the representation data to the host system; arranging a plurality of representations from the representation data at the host system; rendering the plurality of representations of the arranged representation data on an external display; selecting at least one representation of the plurality of representations from a combination of an object and an action from a set of actions to be performed on the object on the mobile device; inputting the selected at least one representation and the code to the mobile device; mapping the inputted at least one representation to the combination of the object and the action; and performing the action upon the object at the mobile device in response to the inputting, wherein the code is displayed with each of the plurality of representations on the external display, and wherein the code corresponding to each of the plurality of representations encodes a respective object and a respective action to be performed on the respective object on the mobile device.