Estimating depth from a single image

摘要

During a training phase, a machine accesses reference images with corresponding depth information. The machine calculates visual descriptors and corresponding depth descriptors from this information. The machine then generates a mapping that correlates these visual descriptors with their corresponding depth descriptors. After the training phase, the machine may perform depth estimation based on a single query image devoid of depth information. The machine may calculate one or more visual descriptors from the single query image and obtain a corresponding depth descriptor for each visual descriptor from the generated mapping. Based on obtained depth descriptors, the machine creates depth information that corresponds to the submitted single query image.

主权项

1. A method comprising:
accessing reference images and corresponding reference depth maps from a reference database, a first reference image corresponding to a first reference depth map and including a color pixel defined by at least three color values, the first reference depth map including a depth value that corresponds to the color pixel in the first reference image; calculating visual descriptors and corresponding depth descriptors from the accessed reference images and their corresponding reference depth maps; generating a matrix that correlates the calculated visual descriptors with their calculated corresponding depth descriptors, the generating of the matrix being performed by a processor of a machine; receiving a query image that depicts a surface of a shippable item; calculating a visual descriptor from the received query image; obtaining a depth descriptor that corresponds to the calculated visual descriptor from the generated matrix; creating a depth map that corresponds to the query image based on the obtained depth descriptor that corresponds to the visual descriptor calculated from the query image; partitioning the query image into superpixels; modifying the created depth map that corresponds to the query image, the modifying of the created depth map including modifying an orientation of a plane represented by a superpixel in the query image; calculating a length of the surface of the shippable item; and providing the calculated length of the surface of the shippable item to a shipping application.