SILHOUETTE-BASED OBJECT AND TEXTURE ALIGNMENT, SYSTEMS AND METHODS

摘要

An object-image alignment data generating method for use in an object recognition system is presented. The method obtains a 3D model and a set of 2D images of the object. Each 2D image from the set is captured based on a particular camera point of view. The method then uses the 3D model of the object to generate multiple silhouettes of the object according to different camera point of views. Each silhouette is then matched and aligned with a 2D image based on the corresponding camera point of view. The method also derives at least one descriptor from the 2D images and compiles feature points that correspond to the descriptors. Each feature point includes a 2D location and a 3D location. The method then generates an object-image alignment packet by packaging the 2D images, the descriptors, and the feature points.

主权项

1. A computer-based method of generating object-image alignment data, the method comprising:
obtaining, via an image processing engine, a digital three-dimensional (3D) model of an object; obtaining, via the image processing engine, a set of two-dimensional (2D) images of the object from a plurality of image view points; generating, via the image processing engine, a silhouette of the object from the digital 3D model where the silhouette comprises a collection of edge points associated with edges of the digital 3D model from a silhouette point of view; registering, via the image processing engine, at least one image from the set of 2D images with the silhouette based an image view point associated with the at least one image and the silhouette point of view; deriving, via the image processing engine, at least one descriptor from the at least one image; compiling, via the image processing engine, alignment points based on the at least one descriptor and the collection of edge points, the alignment points including at least some of the edge points; and generating, via the image processing engine, an object-image alignment packet by packaging the at least one image with alignment points.