Indirect multi-touch interaction

摘要

Indirect multi-touch interaction is described. In an embodiment, a user interface is controlled using a cursor and a touch region comprising a representation of one or more digits of a user. The cursor and the touch region are moved together in the user interface in accordance with data received from a cursor control device, such that the relative location of the touch region and the cursor is maintained. The representations of the digits of the user are moved in the touch region in accordance with data describing movement of the user's digits. In another embodiment, a user interface is controlled in a first mode of operation using an aggregate cursor, and switched to a second mode of operation in which the aggregate cursor is divided into separate portions, each of which can be independently controlled by the user.

主权项

1. A computer-implemented method of controlling a user interface displayed on a display device, comprising:
receiving a first data sequence describing movement of a cursor control device relative to a non-display surface, the cursor control device being separate from the display device and operable by a user; receiving a second data sequence describing movement of a digit of the user; receiving an indication of a selection of a fixed mode or a relative mode; displaying in the user interface a cursor and a touch region comprising a representation of the digit of the user; processing the first data sequence such that, when the fixed mode is selected, movement of the cursor control device moves the cursor independent of the touch region in the user interface and, when the relative mode is selected, movement of the cursor control device moves the cursor and the touch region in the user interface, whilst maintaining the location of the touch region relative to the cursor; and processing the second data sequence such that movement of the digit by the user moves the representation of the digit in the touch region.