Eye gaze user interface and calibration method

摘要

A software controlled user interface and calibration method for an eye gaze controlled device, designed to accommodate angular accuracy versus time averaging tradeoffs for eye gaze direction sensors. The method can scale between displaying a small to large number of different eye gaze target symbols at any given time, yet still transmit a large array of different symbols to outside devices with minimal user training. At least part of the method may be implemented by way of a virtual window onto the surface of a virtual cylinder, with eye gaze sensitive symbols that can be rotated by eye gaze thus bringing various groups of symbols into view, and then selected by continual gazing. Specific examples of use of this interface and method on an eyeglasses-like head-mountable, vision-controlled, device are disclosed, along with various operation examples including sending and receiving text messages, control of robotic devices and control of remote vehicles.

主权项

1. A method of controlling a vision-controlled, head-mounted frame device for transmitting and receiving information from a human user with at least one eye, said device having a virtual display and at least one eye position tracking sensor, said method comprising:
displaying a plurality of visual targets on said virtual display, said plurality of visual targets each comprising a visible element embedded within an eye position zone with an area that is equal to or larger than said visible element; at least three or more of said visual targets disposed in a user interface comprising at least a surface of a virtual solid capable of rotation, at least three or more of said plurality of visual targets disposed across said surface in a regularly recurring order, thus providing a predictable disposition of visual elements and corresponding visual targets; displaying at least three different visible elements from at least three different visual targets from said user interface on said virtual display, producing displayed virtual solid visual targets; using said at least one eye position tracking sensor to determine when said at least one eye is on average continuously gazing in a direction that is within the eye position zone of at least one of said plurality of visual targets for a time period exceeding a hovering time interval, signaling when said hovering time interval has been exceeded, and if said gaze remains within the eye position zone of said at least one of said plurality of visual targets, without looking away, for a time period exceeding a keypress time interval, registering that an eye gaze controlled virtual key corresponding to said at least one of said displayed virtual solid visual targets has been pressed by said user; and using said eye gaze controlled virtual key presses to control either transmitting or receiving said information to at least one computerized device outside of said head-mounted frame device.