Gesture-based interface with enhanced features

摘要

A method includes presenting, on a display coupled to a computer, an image of a keyboard comprising multiple keys, and receiving a sequence of three-dimensional (3D) maps including a hand of a user positioned in proximity to the display. An initial portion of the sequence of 3D maps is processed to detect a transverse gesture performed by a hand of a user positioned in proximity to the display, and a cursor is presented on the display at a position indicated by the transverse gesture. While presenting the cursor in proximity to the one of the multiple keys, one of the multiple keys is selected upon detecting a grab gesture followed by a pull gesture followed by a release gesture in a subsequent portion of the sequence of 3D maps.

主权项

1. A method, comprising:
presenting, on a display coupled to a computer, an image of a keyboard comprising multiple keys; receiving a sequence of three-dimensional (3D) maps including a hand of a user positioned in proximity to the display; processing an initial portion of the sequence of 3D maps to detect a transverse gesture performed by the hand of the user positioned in proximity to the display, the transverse gesture including a movement of the hand in a direction that is parallel to a plane of the display; presenting, on the display, a cursor at a position indicated by the transverse gesture; and selecting, while presenting the cursor in proximity to one of the multiple keys, the one of the multiple keys upon detecting a grab gesture followed by a pull gesture followed by a release gesture in a subsequent portion of the sequence of 3D maps.