Identifying gestures using multiple sensors

摘要

Systems and methods for recognizing human gestures are disclosed. In one embodiment, a method for recognizing a gesture made by an operator with a portable device, may comprise: obtaining a first sensor data profile associated with measurements made by the first sensor while the operator made a specific gesture involving the portable device; obtaining a second sensor data profile associated with measurements made by the second sensor while the operator made the specific gesture involving the portable device; and identifying the specific gesture by analyzing the first sensor data profile and the second sensor data profile.

主权项

1. A computer implemented method for recognizing a clapping gesture made by an operator with a portable device and generating an applause response, the portable device including at least a kinematic sensor and an audio sensor, the computer implemented method comprising:
obtaining a kinematic sensor data profile associated with measurements made by the kinematic sensor while the operator performs a specific gesture involving the portable device during a time window having a beginning and end; wherein, the specific gesture includes the operator holding the portable device in a palm of a first hand and clapping the portable device into a palm of a second hand; obtaining an audio sensor data profile associated with measurements made by the audio sensor while the operator performs the specific gesture involving the portable device; wherein, the audio sensor data profile corresponds with a substantially identical time window as the kinematic sensor data profile; analyzing the kinematic sensor data profile and the audio sensor data profile; wherein the analyzing comprises:
normalizing the kinematic sensor data profile and audio sensor data profile;comparing the normalized kinematic sensor data profile and normalized audio sensor data profile against a database of known sensor data profiles;wherein, the database of known sensor data profiles comprises at least a first known sensor data profile known to correspond to a clapping gesture, the first known sensor data profile is characterized by an acceleration impulse near the beginning of the time window, a deceleration impulse near the end of the time window, and an audio signal impulse near the end of the time window; determining that the specific gesture corresponds to a clapping gesture based on the analyzing of the kinematic sensor data profile and the audio sensor data profile; and in response to determining that the specific gesture corresponds to a clapping gesture, generating an applause response; wherein, the applause response comprises an audio output component; and wherein, the audio output component of the applause response is based on the kinematic sensor data profile and the audio sensor data profile.