Method and system for constructing personalized avatars using a parameterized deformable mesh

摘要

A method and apparatus for generating a 3D personalized mesh of a person from a depth camera image for medical imaging scan planning is disclosed. A depth camera image of a subject is converted to a 3D point cloud. A plurality of anatomical landmarks are detected in the 3D point cloud. A 3D avatar mesh is initialized by aligning a template mesh to the 3D point cloud based on the detected anatomical landmarks. A personalized 3D avatar mesh of the subject is generated by optimizing the 3D avatar mesh using a trained parametric deformable model (PDM). The optimization is subject to constraints that take into account clothing worn by the subject and the presence of a table on which the subject in lying.

主权项

1. A method of generating a personalized 3D avatar mesh of a human subject from a depth camera image for medical imaging scan planning, comprising:
converting a depth camera image of a subject to a 3D point cloud; detecting a plurality of anatomical landmarks in the 3D point cloud; initializing a 3D avatar mesh by aligning a template mesh to the 3D point cloud based on the detected anatomical landmarks; and generating a personalized 3D avatar mesh of the subject by optimizing the 3D avatar mesh using a trained parametric deformable model (PDM)wherein generating a personalized 3D avatar mesh of the subject by optimizing the 3D avatar mesh using a trained parametric deformable model (PDM) comprises:
optimizing parameters of the trained PDM that control a pose and shape of the 3D avatar mesh and locations of vertices of the 3D avatar mesh to minimize a cost function, and wherein the cost function includes a table constraint that causes the optimization to move vertices of the 3D avatar above a table on which the subject is lying.