Photo-image-based 3D modeling system on a mobile device

摘要

A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.

主权项

1. A computer-implemented method for altering three-dimensional models based on two-dimensional images, comprising:
(a) capturing, with a first camera of a mobile device, a local photographic image with a first field of view; (b) detecting, using information from a location sensor associated with the mobile device, a first location and a first orientation of the first camera when the local photograph was captured in (a), wherein a first camera model includes the first location and the first orientation; (c) sending a request to a server, separate from the mobile device, for an additional photographic image captured from a second camera remote from the mobile device, the additional photographic image having a second field of view overlapping with the first field of view; (d) receiving, from the server, the additional photographic image and a second camera model including a location and an orientation of the second camera when the additional photographic image was captured; (e) receiving a user constraint input by a user of the mobile device to be applied within a three-dimensional model, the user constraint associating an image position on the local photographic image with a corresponding position within the three-dimensional model; and (f) applying a photogrammetry algorithm to alter the three-dimensional model based, at least in part on, the first and second camera models and the user constraint such that the local photographic image is integrated into the three-dimensional model in a manner that locates the image position at the corresponding position within the three-dimensional model.