Generation of a three-dimensional representation of a user

摘要

Described herein are technologies pertaining to generating a relatively accurate virtual three-dimensional model of a head/face of a user. Depth frames are received from a depth sensor and color frames are received from a camera, wherein such frames capture a head of a user. Based upon the depth frames and the color frames, the three-dimensional model of the head of the user is generated.

主权项

1. A method that facilitates constructing a computer-implemented three-dimensional representation of a head of a user, the method comprising:
receiving a plurality of red-green-blue (RGB) frames of the head of the user from a camera, the plurality of RGB frames captured by the camera over a range of time; receiving a plurality of depth frames from a depth sensor, the depth frames being indicative of distances of respective portions of the head of the user from the depth sensor, the depth frames generated by the depth sensor over the range of time, wherein orientation of the head of the user relative to the camera and the depth sensor changes during the range of time; identifying a feature of the head of the user in the plurality of RGB frames, the feature being one of a center of an eye of the user, a center of a nose of the user, a first nasal alar of the user, or a second nasal alar of the user; aligning the plurality of depth frames with one another based upon the feature of the head of the user identified in the plurality of RGB frames; in response to aligning the plurality of depth frames with one another, computing a three-dimensional point cloud based upon the plurality of depth frames being aligned with one another; generating a three-dimensional mesh of the head of the user based upon the three-dimensional point cloud; and texturizing the three-dimensional mesh based upon the plurality of RGB frames.