OPERATION RECOGNITION DEVICE AND RECORDED MEDIUM RECORDING OPERATION RECOGNITION PROGRAM

摘要

PROBLEM TO BE SOLVED: To reproduce a motion of a person or the like in real time by directly calculating a direction and a strength of a motion for each pixel of an obtained image and moving simulatingly a model based on a motion of each estimated part so as to reproduce an operation of an image pickup object. SOLUTION: An image input section 1 is provided with pluralities of image sensors and picks up a motion of an object from an angle different from each image sensor. A 2-dimension motion detection section 2 calculates a 2-dimensional motion with an optical flow or the like for each image outputted sequentially from each image sensor. An area specification section 3 specifies an area having a strong motion based on the detected optical flow and calculates the direction and the strength of the 2-dimensional motion of the entire area. A 3-dimension motion detection section 4 cross-references the area specified by the area specification section 3 with the 2-dimension image by using difference from the pickup angle of each image sensor to calculate a 3-dimensional motion including the depth dimension. A position estimate section 5 estimates to which part of motion of a person the area corresponds and an operation reproduction section 6 moves simulatingly a person model based on the motion of the estimated part.