Method and system for three-dimensionally reconstructing non-rigid body based on multi-depth-map

摘要

A method and a system for three-dimensionally reconstructing a non-rigid body based on a multi-depth-map are provided. The method comprises: obtaining a plurality of depth maps by shooting the non-rigid body in different postures and from different angles; transforming each depth map to one group of three-dimensional point clouds and obtaining a plurality of matching point pairs among a plurality of groups of three-dimensional point clouds; conducting a position transformation for each matching point and obtaining a transformation parameter corresponding to the each matching point after the position transformation; mosaicing all transformation parameters to obtain a mosaicing result and constructing an energy function according to the mosaicing result; and solving the energy function to obtain a solution result and reconstructing a three-dimensional model of the non-rigid body according to the solution result.

主权项

1. A method for three-dimensionally reconstructing a non-rigid body based on a multi-depth-map, comprising:
obtaining, by a depth camera, a plurality of depth maps by shooting the non-rigid body in different postures and from different angles; transforming, by a processor, each depth map to one group of three-dimensional point clouds and obtaining a plurality of matching point pairs among a plurality of groups of three-dimensional point clouds; conducting, by the processor, a position transformation for each matching point and obtaining a transformation parameter corresponding to the each matching point after the position transformation; mosaicing, by the processor, all transformation parameters to obtain a mosaicing result and constructing an energy function according to the mosaicing result, wherein the energy function is:X=arg⁢⁢minX⁢⁢αe⁢Ee+αf⁢Ef+αn⁢En where Ee is a topology constraint, Ef is a feature constraint, En is a nearest point constraint, and αe, αf and αn are weighting coefficients of Ee, Ef and En respectively; and solving, by the processor, the energy function to obtain a solution result and reconstructing a three-dimensional model of the non-rigid body according to the solution result.