System and method for generating a representative computerized display of a user's interactions with a touchscreen based hand held device on a gazed-at screen

摘要

A system and method of interacting with a smartphone application displayed over a remote display gazed at by a user including a normal mode of operation which may be the default, a hovering mode of operation which may be triggered by a trigger event, and a release event which reverts from hovering mode to normal mode. An enhanced hovering ability is typically provided while hovering, in that a predetermined set of operative gestures is enabled, such that a range of predetermined gestures is available for operating purposes while hovering.

主权项

1. A method for interacting with a touch screen based hand held device, the method being operative in conjunction with an external digital display having a gazed-at display screen, on which a first image is provided which is based on another image produced by a touch screen based hand held device, the method including:
in a first, normal, default mode of operation, sensing a user's interactions with the touch screen based hand held device and modifying a display on the touchscreen based hand held device accordingly; in a second, hovering, mode of operation, triggered by a trigger event and terminated by a release event:
sensing the user's interactions with the touch screen based hand held device andgenerating a representative display of the user's interactions superimposed on the first image; anddetecting at least one predetermined compound touch event generated by the user's interaction with the touch screen, including a first touch event component at a first location on the touch screen indicative of a location and a second sequenced touch event component at a second location on the touch screen indicative of an operative action to be performed within said normal mode of operation, and performing said operative action indicated by said second touch event component at said touch screen location indicated by said first touch event component ignoring the second location.