Object tracking in a 3-dimensional environment

摘要

The movement of an object is tracked in a 3D environment. In some cases, the object is a hand which may be used for gesture input to an augmented reality system. In a particular implementation, 3D images of the environment may be captured and 2D contours of objects within the environment may be generated. Overlap between regions defined by the 2D contours of objects in the 3D images may be utilized to determine whether an object in a first 3D image is the same as an object in a second 3D image that is captured subsequent to the first 3D image.

主权项

1. A system comprising:
one or more processors; one or more cameras to obtain at least a first 3D image of an environment at a first time and a second 3D image of the environment at a second time subsequent to the first time; one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
detecting a first hand segment in the first 3D image;detecting a second hand segment in the second 3D image;identifying a first continuous surface in the first 3D image corresponding to the first hand segment;determining first 3D boundaries of the first continuous surface;generating a first contour of the first hand segment based, at least in part, on the first 3D boundaries of the first continuous surface;identifying a second continuous surface in the second 3D image, the second continuous surface corresponding to the second hand segment;determining second 3D boundaries of the second continuous surface;generating a second contour of the second hand segment based, at least in part, on the second 3D boundaries of the second continuous surface;determining whether a region defined by the second contours of the second hand segment overlaps with a region defined by the first contour of the first hand segment; anddetermining that the first hand segment and the second hand segment are a same respective hand segment when an amount of overlap between the region defined by the second contours of the second hand segment and the region defined by the first contours of the first hand segment satisfies a threshold amount.