Video compression using virtual skeleton

摘要

Optical sensor information captured via one or more optical sensors imaging a scene that includes a human subject is received by a computing device. The optical sensor information is processed by the computing device to model the human subject with a virtual skeleton, and to obtain surface information representing the human subject. The virtual skeleton is transmitted by the computing device to a remote computing device at a higher frame rate than the surface information. Virtual skeleton frames are used by the remote computing device to estimate surface information for frames that have not been transmitted by the computing device.

主权项

1. A method for a computing system, comprising:
receiving optical sensor information captured via one or more optical sensors, the optical sensor information imaging a scene including a human subject; processing the optical sensor information to model the human subject with a virtual skeleton; processing the optical sensor information to obtain surface information representing the human subject; transmitting the virtual skeleton to a remote computing device at a first frame rate; and transmitting the surface information to the remote computing device at a second frame rate that is less than the first frame rate.