APPARATUS AND METHOD FOR CONTROLLING INTERFACE USING HAND GESTURE AND COMPUTER-READABLE RECORDING MEDIUM WITH PROGRAM THEREFOR

摘要

The present invention provides a device and a method thereof for manipulating the interface of an electronic device by recognizing a movement (gesture) according to the hand gesture of a user through using an image photographed by a camera without directly selecting a select menu board which is displayed on a display screen, wherein the present invention includes an image securing part for outputting the continuous photographed images of the movements of hand gestures moving on the basis of the select menu board; a gesture recognizing part for recognizing at least two gestures according to the number of the points of user body which is recognized at the image outputted at the image securing part; an information comparing part for detecting gesture information matching with the recognized gesture by comparing the recognized gesture with the preliminarily stored gesture information; and a function processing part for generating a sequence by using the detected gesture information before detecting the manipulation command message, which is corresponding to the generated sequence, of an electronic device at a storing part which is stored in advance for outputting the message to the main controlling part of the electronic device. [Reference numerals] (110) Screen processing part;(120) Image securing part;(130) Gesture recognizing part;(140) Gesture information comparing part;(150) Function processing part;(160) Voice guidance part;(170) Storing part;(171) Selection menu information DB;(172) Gesture information DB;(173) Operation control information DB;(174) Voice information DB;(200) Display part;(300) Appliance main control unit