Scalable real-time motion recognition

摘要

Human body motion is represented by a skeletal model derived from image data of a user. The model represents joints and bones and has a rigid body portion. The sets of body data are scaled to a predetermined number of sets for a number of periodic units. A body-based coordinate 3-D reference system having a frame of reference defined with respect to a position within the rigid body portion of the skeletal model is generated. The body-based coordinate 3-D reference system is independent of the camera's field of view. The scaled data and representation of relative motion within an orthogonal body-based 3-D reference system decreases the data and simplifies the calculations for determining motion thus enhancing real-time performance for multimedia applications controlled by a user's natural movements.

主权项

1. A method of scalable real-time motion recognition and/or similarity analysis of human body motion based on skeletal model data derived from image data of a user comprising:
(a) detecting an object from data received by a capture device; (b) determining whether the object detected in said step (a) corresponds to a human user; (c) directly detecting positions of body parts of the user where it is determined in said step (b) that the detected object comprises a human user and the data comprises skeletal data, the data represented in a 3-D reference system of the capture device; (d) transforming the data into a body-based coordinate 3-D reference system having a frame of reference of the user, the body-based coordinate 3-D reference system including a plurality of joints described as a single rigid body so that the plurality of joints do not move relative to each other; and (e) outputting a computer model of the user based in part on body-based coordinate 3-D reference system.