Detecting and modifying facial features of persons in images

摘要

Implementations relate to detecting and modifying facial features of persons in images. In some implementations, a method includes receiving one or more general color models of color distribution for a facial feature of persons depicted in training images. The method obtains an input image, and determines a feature mask associated with the facial feature for one or more faces in the input image. Determining the mask includes estimating one or more local color models for each of the faces in the input image based on the general color models, and iteratively refining the estimated local color models based on the general color models. The refined local color models are used in the determination of the feature mask. The method applies a modification to the facial feature of faces in the input image using the feature mask.

主权项

1. A method comprising:
receiving one or more general color models of color distribution for a facial feature of persons depicted in a plurality of training images; obtaining an input image; determining a probability location mask in a feature region for each of one or more faces detected in the input image, the probability location mask indicating probabilities based on locations in the feature region and providing a higher probability at the center of the feature region than at the edges; determining a feature mask associated with the facial feature for the one or more faces detected in the input image, wherein determining the feature mask uses the one or more general color models and the probability location mask and includes:
estimating one or more local color models for each of the one or more faces in the input image based on the one or more general color models; andrefining the one or more estimated local color models for each of the one or more faces in the image based on the one or more general color models, wherein the refined one or more local color models are used in the determination of the feature mask; and applying a modification to the facial feature of at least one of the one or more faces in the input image using the feature mask.