INTERACTION OF MULTIPLE PERCEPTUAL SENSING INPUTS

摘要

A system and method for using multiple perceptual sensing technologies to capture information about a user's actions and for synergistically processing the information is described. Non-limiting examples of perceptual sensing technologies include gesture recognition using depth sensors, two-dimensional cameras, gaze detection, and/or speech recognition. The information captured about a user's gestures using one type of sensing technology is often not able to be captured with another type of technology. Thus, using multiple perceptual sensing technologies allows more information to be captured about the user's gestures. Further, by synergistically leveraging the information acquired using multiple perceptual sensing technologies, a more natural user interface can be created for a user to interact with an electronic device.

主权项

1. A method comprising:
acquiring data about a user's actions using a plurality of perceptual sensing technologies; analyzing the acquired data to identify a gesture from the user's actions, wherein the gesture is defined based upon information able to be detected by the plurality of perceptual sensing technologies.