Real-time 3D reconstruction with power efficient depth sensor usage

摘要

Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.

主权项

1. A method on a Mobile Station (MS) comprising at least one camera and a depth sensor, the method comprising:
capturing a first image with the at least one camera, the first image comprising color information for an environment being modeled by the MS; obtaining a camera pose for the first image; determining, based, in part, on color information in the first image and the camera pose for the first image, whether to update a volumetric dataset associated with a first 3-Dimensional (3D) model of the environment; and enabling the depth sensor to capture depth information when the first 3D model is to be updated, wherein the captured depth information is used, at least in part, to update the first 3D model using volumetric reconstruction.