USER INTERFACE CONTROL USING GAZE TRACKING

摘要

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying a direction in which a user is looking. In one aspect, a method includes receiving an image of a sequence of images. The image can depict a face of a user. A template image for each particular facial feature point can be compared to one or more image portions of the image. The template image for the particular facial feature point can include a portion of a previous image of the sequence of images that depicted the facial feature point. Based on the comparison, a matching image portion of the image that matches the template image for the particular facial feature point is identified. A location of the matching image portion is identified in the image. A direction in which the user is looking is determined based on the identified location for each template image.

主权项

1. A method performed by data processing apparatus, the method comprising:
receiving an image of a sequence of images, the image depicting a face of a user; for each particular facial feature point of a plurality of facial feature points of the face depicted in the image:
comparing a template image for the particular facial feature point to one or more image portions of the image, the template image for the particular facial feature point including a portion of a previous image of the sequence of images that depicted the facial feature point;identifying, based on the comparison, a matching image portion of the image that matches the template image for the particular facial feature point; andidentifying, in the image, a location of the matching image portion; and determining a direction in which the user is looking based on the identified location for each template image.