Real time eye tracking for human computer interaction

摘要

A gaze direction determining system and method is provided. A two-camera system may detect the face from a fixed, wide-angle camera, estimates a rough location for the eye region using an eye detector based on topographic features, and directs another active pan-tilt-zoom camera to focus in on this eye region. A eye gaze estimation approach employs point-of-regard (PoG) tracking on a large viewing screen. To allow for greater head pose freedom, a calibration approach is provided to find the 3D eyeball location, eyeball radius, and fovea position. Both the iris center and iris contour points are mapped to the eyeball sphere (creating a 3D iris disk) to get the optical axis; then the fovea rotated accordingly and the final, visual axis gaze direction computed.

主权项

1. A method for estimating an eyeball gaze direction based on an image of a face, comprising:
determining, from the image, a center of an iris of the eyeball by:
estimating an outline of the iris in the image,mapping the outline of the iris as a set of perspective vectors intersecting a center of a spherical model of the eyeball,defining a set of iris contour vectors representing normalized vectors extending from the center of the eyeball spherical model to intersecting points of the perspective vectors,computing a statistical average vector of the iris contour vectors as the estimated optic axis of the eyeball, wherein a location of the fovea of the eyeball lies displaced from the optic axis of the eyeball; estimating, from the image, the eyeball gaze direction along a vector, displaced from the optic axis of the eyeball, from a predicted location of the fovea and passing through the determined center of the iris, based on at least:
the determined center of the iris,the center of the spherical model of the eyeball, andthe radius of the spherical model of the eyeball, by rotating an estimated location of the fovea offset based on the optic axis of the eyeball; and calibrating the determined center of the iris and resulting estimated eyeball gaze direction with respect to a known gaze direction, to update parameters defining the estimated eyeball gaze direction for unknown gaze directions.