Portable device for tracking user gaze to provide augmented reality display

摘要

A method for controlling a portable device is disclosed. The method includes displaying a plurality of augmented reality (AR) images, detecting a gaze of a user, determining a target object based on the gaze of the user, identifying an associated AR image that is associated with the target object and a non-associated AR image that is not associated with the target object from the plural AR images, and maintaining display of the associated AR image and terminating display of the non-associated AR image when the target object is a moving object.

主权项

1. A portable device comprising:
a display to display an image; a camera to capture a real object positioned in front of the portable device; and a processor to control the display to display a plurality of augmented reality (AR) images before a target object is determined, wherein the plurality of augmented reality (AR) images include an associated AR image that is associated with the target object and a non-associated AR image that is not associated with the target object, wherein the processor detects a first object moving into a viewing angle of the camera from out of the viewing angle of the camera, wherein the processor sets the first object as the target object in response to detection of a gaze of a user on the first object for a predetermined period of time, wherein the processor identifies the associated AR image and the non-associated AR image among the plurality of displayed AR images, wherein the processor terminates displaying of the non-associated AR image while displaying of the associated AR image is maintained, in response to continuous detection of the gaze of the user on the target object, wherein the processor detects a moving direction of the target object, wherein the processor further determines whether to display the non-associated AR image while the associated AR image is being displayed, based on whether or not the non-associated AR image is positioned on a predicted moving path of the target object, wherein the processor maintains displaying of both the associated AR image and the non-associated AR image, in response to deviation of the gaze of the user from the target object and when the non-associated AR image is not positioned on the predicted moving path of the target object, and wherein the processor maintains displaying the associated AR image and terminates displaying of the non-associated AR image when the non-associated AR image is positioned on the predicted moving path of the target object.