Gesture-based human machine interface

摘要

A gesture-based human machine interface, for example, a user interface for controlling a program executing on a computer, and related method are provided. Gestures of the user are monitored and a response is provided that is based upon the detected gestures. An object is used to point to information displayed on a screen. The information displayed on the screen is modified in response to a determination of the position on the screen to which the object is pointing and in response to the distance of the object from the screen.

主权项

1. A method of using a computer system through a gesture-based human machine interface, the method comprising:
pointing to a position on a screen of the computer system using an object to point, wherein pointing includes maintaining a distance between the object and the screen, the distance being a positive value, and wherein the screen comprises outer corners and a center; capturing images of a space in front of the screen with at least four cameras configured to attach at the outer corners of the screen and point toward the center of the screen, wherein capturing images with the at least four cameras allows a three-dimensional map of the space in front of the screens to be constructed, the space including the object; analyzing the images using a processor to identify the object, to determine the position of the object in three-dimensions, to determine the position on the screen to which the object is pointing, to determine the distance between the object and the screen, and to determine speeds of movement of the object; and modifying information displayed on the screen in response to the determination of both the position on the screen to which the object is pointing and the distance between the object and the screen; wherein modifying the information displayed on the screen comprises magnifying the information displayed on a portion of the screen with a magnification that is dependent upon the determined distance between the object and the screen, wherein a zoom button is positioned at the position on the screen to which the object is pointing; wherein the determined distance is between a maximum value and a minimum value, wherein the magnification scaling varies exponentially as the determined distance varies between the maximum value and the minimum value; and wherein a gradual speed of movement of the object towards a menu option presented on the screen is interpreted as a single click and a rapid speed of movement of the object towards the menu option presented on the screen is interpreted as a double click.