Manipulation of virtual object in augmented reality via intent

摘要

A system and method for manipulating a virtual object based on intent is described. A reference identifier from a physical object is captured. The reference identifier is communicated via a network to a remote server. The remote server includes virtual object data associated with the reference identifier. The virtual object data is received at the computing device. The virtual image is displayed in a virtual landscape using the virtual object data. In response to relative movement between the computing device and the physical object caused by a user, the virtual image is modified. Brain activity data of the user is received. A state of the virtual object in the virtual landscape is changed based on the brain activity data.

主权项

1. A device comprising:
a camera configured to capture a reference identifier from a physical object; a display; an augmented reality application implemented with a hardware processor and configured to communicate the reference identifier via a network to a remote server, the remote server including virtual object data associated with the reference identifier, to receive the virtual object data at the device, to display a virtual object in the display using the virtual object data, in response to a relative movement between the device and the physical object caused by a user, to modify the virtual object in the display; an eye tracking module configured to determine a gaze of the user and identify a location on the virtual object based on the gaze of the user; a brain activity application configured to receive brain activity data of the user in response to the gaze of the user at the identified location on the virtual object, determine a state of mind of the user based on the brain activity data of the user, and to change a state of an interactive feature at the identified location on the virtual object based on the state of mind of the user and the reference identifier captured by the camera; and a visual gesture module configured to identify a focus area of the display, and the change the state of the feature of the virtual object in response to a change in the state of mind of the user, the focus area comprising a predefined portion of the display, the state of the feature changes in response to the feature being located within the predefined portion of the display for a time duration exceeding a time threshold.