Interface selection approaches for multi-dimensional input

摘要

Touch-based input to a computing device can be improved by providing a mechanism to lock or reduce the effects of motion in unintended directions. In one example, a user can navigate in two dimensions, then provide a gesture-based locking action through motion in a third dimension. If a computing device analyzing the gesture is able to detect the locking action, the device can limit motion outside the corresponding third dimension, or lock an interface object for selection, in order to ensure that the proper touch-based input selection is received. Various thresholds, values, or motions can be used to limit motion in one or more axes for any appropriate purpose as discussed herein.

主权项

1. A computer-implemented method for assisting touch-based input to a computing device, comprising:
displaying content on a display screen of the computing device, the content including at least one selectable interface object; capturing an image using a camera of the computing device that includes a representation of a fingertip; analyzing the image, using a processor of the computing device, to determine a position of the fingertip with respect to the computing device; updating a current position of a cursor displayed on the display screen, the cursor configured to move across the content in two dimensions corresponding to movement of the fingertip in a plane relative to the display screen; detecting the current position of the cursor corresponding to a location of at least one selectable interface object; highlighting the at least one selectable interface object in a first color; detecting, from the captured image and using the processor, motion of the fingertip toward the display screen; determining that the current position of the fingertip meets a locking threshold relative to the display screen; locking the current position of the cursor, wherein the locked current position of the cursor does not change during the motion of the fingertip toward the display screen; highlighting the at least one selectable interface object in a second color; and causing the at least one selectable interface object to be selected as a result of the fingertip contacting at least a portion of the display screen.