发明名称 Geometric calibration of head-worn multi-camera eye tracking system
摘要 A system and methods for geometric calibration and use of head-worn multi-camera eye tracking system are provided. The system calibrates the internal and external parameters of the cameras as well as the parameters of a compact geometric model of the human eye. An exo-camera determines a relative pose with regard to a computer monitor and endo-cameras determine the eyeball position and orientation. An endo-exo calibration and an endo-eye calibration each with an optimization step are included. A homography and a joint optimization step are also provided. A single point calibration re-establishes calibration. The system in operational mode determines a user's gaze direction to perform a computer input function.
申请公布号 US8957948(B2) 申请公布日期 2015.02.17
申请号 US201113215365 申请日期 2011.08.23
申请人 Siemens Corporation 发明人 Ernst Jan;Genc Yakup
分类号 H04N13/02;H04N15/00;G09G5/00;H04N13/04;G02B27/01 主分类号 H04N13/02
代理机构 代理人
主权项 1. A method for calibrating a frame worn by a wearer containing an exo-camera directed to a display that is not worn by the wearer and a first and a second endo-camera, each directed to an eye of the wearer, comprising: a processor collecting data related to a projection of an image with a plurality of calibration points on the display with a known set of 3D coordinates in coordinates of the exo-camera directed to the display and in coordinates of the endo-camera as an exo-endo pair; the processor optimizing a relative pose of the exo-endo pair as a set of rotation and translation parameters which minimizes an error criterion; the processor estimating parameters of a geometric model of the eye while a gaze by the eye in an unobstructed manner focuses on a known location on the display; the processor minimizing a gaze projection error on the display with regard to a known ground truth; and the processor determining a relative transformation between an endo-camera coordinate system and an exo-camera coordinate system; and wherein the relative transformation is expressed as: px=Rexpe tex+ wherein Rex εSO(3) is a rotation matrix, wherein SO(3) is a rotation group, tex εR3 is a translation vector, px εR3 is a vector of points in the exo camera coordinate system, and pe εR3 is a vector of points in the endo camera coordinate system.
地址 Iselin NJ US