Method and system for gesture-based human-machine interaction and computer-readable medium thereof

摘要

A method and system for gesture-based human-machine interaction and computer-readable medium are provided. The system includes a capturing module, a positioning module, and a transforming module. The method includes the steps of: capturing images from a user's video streams, positioning coordinates of three or more predetermined color blocks in the foreground, simulating movements of a mouse according to the coordinates of the first color block, and simulating click actions of the mouse according to the coordinates of the other color blocks. The embodiments according to the current disclosure position coordinates of a plurality of color blocks through processing the captured user's video streams, and simulate mouse actions according to the coordinates of the color blocks. Processing apparatuses like computers may be extended to facilitate gesture-based human-machine interactions through a very simple way, and a touch-sensitive interaction effect can be simulated, without the presence of a touch screen.

主权项

1. A method for gesture-based human-machine interaction, comprising:
capturing images from a video stream of a user, wherein each of the images comprises a foreground and a background, and the foreground comprises three or more predetermined color blocks, wherein the three or more predetermined color blocks comprises at least one color block corresponding to one hand of the user, and at least two color blocks corresponding to the other hand of the user; positioning coordinates of the three or more predetermined color blocks in the foreground of the images; and simulating movements of a mouse according to the coordinates of the at least one color block corresponding to the one hand of the user, and simulating click actions of the mouse according to the coordinates of the at least two color blocks corresponding to the other hand of the user.