User body angle, curvature and average extremity positions extraction using depth images

摘要

Embodiments described herein use depth images to extract user behavior, wherein each depth image specifies that a plurality of pixels correspond to a user. In certain embodiments, information indicative of an angle and/or curvature of a user's body is extracted from a depth image. This can be accomplished by fitting a curve to a portion of a plurality of pixels (of the depth image) that correspond to the user, and determining the information indicative of the angle and/or curvature of the user's body based on the fitted curve. An application is then updated based on the information indicative of the angle and/or curvature of the user's body. In certain embodiments, one or more average extremity positions of a user, which can also be referred to as average positions of extremity blobs, are extracted from a depth image. An application is then updated based on the average positions of extremity blobs.

主权项

1. A method for using a depth image to extract user behavior, comprising:
receiving a depth image that specifies that a plurality of pixels correspond to a user; fitting a curve to a portion of the plurality of pixels corresponding to the user to thereby produce a fitted curve comprising a plurality of straight line segments; identifying a first straight line extending between endpoints of the fitted curve; identifying a second straight line extending orthogonally from the first straight line to a point of the fitted curve that is farthest away from the first straight line; and determining, based on the first and second straight lines, information indicative of a curvature of the user's body.