Cross-user hand tracking and shape recognition user interface

摘要

Embodiments include vision-based interfaces performing hand or object tracking and shape recognition. The vision-based interface receives data from a sensor, and the data corresponds to an object detected by the sensor. The interface generates images from each frame of the data, and the images represent numerous resolutions. The interface detects blobs in the images and tracks the object by associating the blobs with tracks of the object. The interface detects a pose of the object by classifying each blob as corresponding to one of a number of object shapes. The interface controls a gestural interface in response to the pose and the tracks.

主权项

1. A system comprising: a detection and tracking algorithm running on a processor that is coupled to a sensor, wherein the detection and tracking algorithm is coupled to a gestural interface; a gestural interface application running on a processor that is coupled to a sensor, the gestural interface application receiving data from the sensor corresponding to an object detected by the sensor, generating images from each frame of the data, wherein the images represent a plurality of resolutions, detecting blobs in the images and tracking the object by associating the blobs with tracks of the object, detecting a pose of the object by classifying each blob as corresponding to one of a plurality of object shapes, and generating a gesture signal in response to the pose and the tracks and controlling a component coupled to the interface system with the gesture signal.