General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces

摘要

A method for a multi-touch gesture-based user interface wherein a plurality of gestemes are defined as functions of abstract space and time and further being primitive gesture segments that can be concatenated over time and space to construct gestures. Various distinct subset of the gestemes can be concatenated in space and time to construct a distinct gestures. Real-time multi-touch gesture-based information provided by user interface is processed to at least a recognized sequence of specific gestemes and that the sequence of gestemes that the user's execution a gesture has been completed. The specific gesture rendered by the user is recognized according to the sequence of gestemes. Many additional features are then provided from this foundation, including gesture grammars, structured-meaning gesture-lexicon, context, and the use of gesture prosody.

主权项

1. A method for a multi-touch gesture- based user interface, the method comprising:
concatenating a first subset of gestemes from a plurality of gestemes based on at least temporal logic and at least one parameter associated with a space function for constructing a first gesture, each gesteme being primitive gesture segments; concatenating a second subset of gestemes from the plurality of gestemes based on at least function for temporal logic and at least one parameter associated with the space function for constructing a second gesture; receiving real-time multi-touch gesture-based information from a multi-touch gesture-based user interface; processing the real-time multi-touch gesture-based information to sequentially identify over intervals of real-time at least a recognized sequence of specific gestemes belonging to the plurality of gestemes; determining from the sequence of gestemes that the user's execution of at least one gesture has been completed; determining from the sequence of gestemes a specific gesture represented by the sequence of gestemes; wherein the gesture is recognized as either the first gesture or the second gesture according to the sequence of gestemes.