DEVICE INTERACTION IN AUGMENTED REALITY

摘要

An augmented reality (AR) device can access a library of applications or user interfaces (UIs) designed to control a set of devices. The AR device can determine which UI to present based on detection of a device to be controlled near the AR device. For example, a user wearing an AR device may look at a thermostat placed on a wall and a UI to control the thermostat may be presented to the user. The determination that the user is looking at the thermostat may be made by correlating the gaze tracking information of the user-facing camera with the location of the thermostat in an image captured by a world-facing camera. Determination of the location of the thermostat in the image can be performed using image recognition technology. The UI can be selected based on a database record pairing the UI with the thermostat.

主权项

1. A method comprising:
at a computing device in possession of a user, capturing an image depicting a target device by a camera of the computing device, the target device being associated with a control interface; identifying the target device by processing the image; and responsive to the identifying of the target device, presenting the control interface on a display.