COMPUTER-IMPLEMENTED GAZE INTERACTION METHOD AND APPARATUS

摘要

A computer-implemented method of communicating via interaction with a user-interface based on a person's gaze and gestures, comprising: computing an estimate of the person's gaze comprising computing a point-of-regard on a display through which the person observes a scene in front of him; by means of a scene camera, capturing a first image of a scene in front of the person's head (and at least partially visible on the display) and computing the location of an object coinciding with the person's gaze; by means of the scene camera, capturing at least one further image of the scene in front of the person's head, and monitoring whether the gaze dwells on the recognised object; and while gaze dwells on the recognised object: firstly, displaying a user interface element, with a spatial expanse, on the display face in a region adjacent to the point-of-regard; and secondly, during movement of the display, awaiting and detecting the event that the point-of-regard coincides with the spatial expanse of the displayed user interface element. The event may be processed by communicating a message.

主权项

1. A computer-implemented method of responding to a person's gaze, comprising:
computing an estimate of the person's gaze comprising computing a point-of-regard on a screen through which the person observes a scene; identifying an object the person is looking at, if any, using the estimate of the person's gaze and information about an object's identity and location relative to the gaze; detecting an event indicating that the person wants to interact with the object, and in response thereto displaying a predefined user interface element on the screen in a region adjacent to the point of regard; verifying, during movement of the screen, that gaze is fixed on the object; and then detecting the event that the point-of-regard coincides with the spatial expanse of a predefined displayed user interface element; and processing the event that the point-of-regard coincides with the spatial expanse of a predefined displayed user interface element comprising performing an action.