User input processing with eye tracking

摘要

A system determines which user of multiple users provided input through a single input device. A mechanism captures images of the one or more users. When input is detected, the images may be processed to determine which user provided an input using the input device. The images may be processed to identify each users head and eyes, and determine the focus point for each user's eyes. The user which has eyes focused at the input location is identified as providing the input. When the input mechanism is a touch screen, the user having eyes focused on the touch screen portion which was touched is identified as the source of the input.

主权项

1. A method for receiving input at a touch-sensitive device, comprising:
capturing image data for a physical area surrounding the touch-sensitive device; identifying a plurality of physically present users at the touch-sensitive device by identifying head candidates from the captured image data, wherein the identifying includes: analyzing the captured image data for shapes resembling a human head, wherein the shapes are detected using contrast detection and motion detection, evaluating each shape in the captured image data resembling a human head for the presence of features common to most human heads, wherein the features include contrast or shading present on the shape based on where the nose, mouth or eye may be found, assigning the evaluated shape a value corresponding to a likelihood that the evaluated shape is a human head based on the presence of one or more features, and determining that the assigned value for a particular evaluated shape is greater than a threshold indicative that the evaluated shape corresponds to a participating user; identifying facial features for each of the physically present users, the facial features including the eyes of each of the plurality of physically present users; calibrating the eyes of each of the plurality of physically present users prior to engaging in real-time interactions with the touch-sensitive device, the calibration including focus with a plurality of pre-defined regions of the touch-sensitive device; tracking an eye focus for the eyes of each of the plurality of physically present users in real-time and following calibration, the eye focus including an analysis of the area and location of sclera versus pupil for each eye of each of the plurality of physically present users; receiving a touch input at the touch-sensitive device, wherein the touch input is detected at a hot spot on a touch screen display of the touch-sensitive device; and associating the touch input with an acting user of the plurality of physically present users based on the tracking of the eye focus of each of the plurality of physically present users, wherein the acting user is determined to have an eye focus closest to the hot spot as a result of the analysis of the area and location of sclera versus pupil for the eyes of each of the plurality of physically present users.