DEPTH IMAGE PROCESSING

摘要

Embodiments described herein can be used to detect holes in a subset of pixels of a depth image that has been specified as corresponding to a user, and to fill such detected holes. Additionally, embodiments described herein can be used to produce a low resolution version of a subset of pixels that has been specified as corresponding to a user, so that when an image including a representation of the user is displayed, the image respects the shape of the user, yet is not a mirror image of the user. Further, embodiments described herein can be used to identify pixels, of a subset of pixels specified as corresponding to the user, that likely correspond to a floor supporting the user. This enables the removal of the pixels, identified as likely corresponding to the floor, from the subset of pixels specified as corresponding to the user.

主权项

1. A method for use with depth images, comprising:
(a) obtaining a depth image and information that specifies that a subset of pixels within the depth image correspond to a user; (b) identifying one or more spans of pixels, within the subset of pixels specified as corresponding to the user, that are potentially part of a hole in the subset of pixels that resulted from a portion of the user occluding another portion of the user when a capture device was used to obtain the depth image or a higher resolution version of the depth image; (c) analyzing span adjacent pixels to determine whether one or more span adjacent pixels are also to be identified as potentially being part of a hole in the subset of pixels specified as corresponding to the user; and (e) grouping together pixels that are adjacent to one another and have been identified as potentially being part of a hole in the subset of pixels specified as corresponding to the user, to thereby identify one or more islands of pixels that potentially correspond to one or more holes in the subset of pixels specified as corresponding to the user.