METHOD AND SYSTEM FOR HUMAN-TO-COMPUTER GESTURE BASED SIMULTANEOUS INTERACTIONS USING SINGULAR POINTS OF INTEREST ON A HAND

摘要

Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

主权项

1. A method for providing natural human-to-computer interaction based on a three-dimensional hand gesture recognition system, the method comprising the steps of:
a) imaging a scene including at least one hand of at least one user; b) processing the imaged scene to determine at least two points of interest associated with said at least one hand; c) tracking said at least two points of interest to provide a tracked movement of each point of interest with respect to time; d) analysing said tracked movement of each point of interest; e) determining, from the analysis of said tracked movement, the simultaneous performance of an activation gesture based on two points of interest, and a pointing gesture based on a single point of interest; and f) using said determined performance of said activation gesture and said pointing gesture for human-to-computer interaction.