Vector-based face recognition algorithm and image search system

摘要

Systems and methods for performing face recognition and image searching are provided. A system for face recognition and image searching includes an ingestion system, a search system, a user device, and a database of galley files that include feature vectors. The ingestion system crawls the internet starting with a seed URL to scrape image files and generate feature vectors. Feature vectors of images input by a user may be compared by the search system to feature vectors in the gallery files. A method for generating feature vectors includes landmark detection, component aligning, texture mapping, vector computation, comparing cluster centers defined by vectors stored in a database with vectors generated based on an input image, linear discriminant analysis, and principal component analysis.

主权项

1. A method, performed by an ingestion system including one or more servers for enrollment and web crawling, for creating a searchable database of feature vectors representing images of a faces, the method comprising:
receiving an image of a face; detecting landmarks on the image of the face and associating the detected landmarks with points; subjecting the points to a transformation; aligning a portion of the image of the face in accordance with the transformation; performing texture mapping on the portion of the image of the face; computing a first vector based on the portion of the image of the face; creating a second vector based on a similarity of the first vector to each of a predetermined number of a first plurality of vectors; generating a feature vector by concatenating the second vector with a second plurality of vectors, wherein the second vector and each of the second plurality of vectors each correspond to a respective portion of the image of the face; and storing the feature vector, along with associated metadata as part of a gallery file, in a database.