Methods and Software for Hallucinating Facial Features By Prioritizing Reconstruction Errors

摘要

Identifying a masked suspect is one of the toughest challenges in biometrics that exist. This is an important problem faced in many law-enforcement applications on almost a daily basis. In such situations, investigators often only have access to the periocular region of a suspect's face and, unfortunately, conventional commercial matchers are unable to process these images in such a way that the suspect can be identified. Herein, a practical method to hallucinate a full frontal face given only a periocular region of a face is presented. This approach reconstructs the entire frontal face based on an image of an individual's periocular region. By using an approach based on a modified sparsifying dictionary learning algorithm, faces can be effectively reconstructed more accurately than with conventional methods. Further, various methods presented herein are open set, and thus can reconstruct faces even if the algorithms are not specifically trained using those faces.

主权项

1. A method of hallucinating facial features by prioritizing reconstruction errors, comprising:
receiving an image of a first region of a first face, the first region containing one or more first facial features; training a machine-learning algorithm using a set of images each containing a region of a face of an individual corresponding to the first region and a region of the face of the individual not corresponding to the first region to produce machine-learning data or receiving machine-learning data corresponding to a previous implementation of such training; and hallucinating one or more second facial features of the first face, the second facial features differing from the one or more first facial features, as a function of the machine-learning data by prioritizing reconstruction errors for hallucinating the one or more second facial features such that reconstruction error for the one or more first facial features is minimized with a higher priority than reconstruction error for hallucinating the one or more second facial features.