Real-time 3D reconstruction with power efficient depth sensor usage

摘要

Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.

主权项

1. A method on a Mobile Station (MS) comprising at least one camera and a depth sensor, the method comprising:
capturing a first image with at least one camera, the first image comprising color information for at least a portion of an environment being modeled by the MS; obtaining camera pose information for the first image; determining, based, in part, on the first image and the camera pose information for the first image, whether to extend a first 3-Dimensional (3D) model of the environment by merging a partial model of the environment being modeled by the MS with the first 3D model of the environment; and enabling the depth sensor, when the first 3D model is extended.