MODEL FITTING FROM RAW TIME-OF-FLIGHT IMAGES

摘要

Model fitting from raw time of flight image data is described, for example, to track position and orientation of a human hand or other entity. In various examples, raw image data depicting the entity is received from a time of flight camera. A 3D model of the entity is accessed and used to render, from the 3D model, simulations of raw time of flight image data depicting the entity in a specified pose/shape. The simulated raw image data and at least part of the received raw image data are compared and on the basis of the comparison, parameters of the entity are computed.

主权项

1. A method of tracking parameters of an entity comprising:
receiving raw image data depicting the entity from a time of flight camera; accessing a 3D model of the entity, the 3D model having model parameters; rendering, from the 3D model having specified values of the model parameters, simulations of raw time of flight image data depicting the entity; comparing the simulated raw image data and at least part of the received raw image data; calculating, on the basis of the comparison, values of the tracked parameters of the entity.