Holographic object feedback

摘要

Methods for providing real-time feedback to an end user of a mobile device as they are interacting with or manipulating one or more virtual objects within an augmented reality environment are described. The real-time feedback may comprise visual feedback, audio feedback, and/or haptic feedback. In some embodiments, a mobile device, such as a head-mounted display device (HMD), may determine an object classification associated with a virtual object within an augmented reality environment, detect an object manipulation gesture performed by an end user of the mobile device, detect an interaction with the virtual object based on the object manipulation gesture, determine a magnitude of a virtual force associated with the interaction, and provide real-time feedback to the end user of the mobile device based on the interaction, the magnitude of the virtual force applied to the virtual object, and the object classification associated with the virtual object.

主权项

1. An electronic device for providing feedback associated with virtual object interactions, comprising:
one or more processors, the one or more processors acquire a first virtual object and determine an object classification associated with the first virtual object, the one or more processors detect an object manipulation gesture performed by an end user of the electronic device and detect an interaction with the first virtual object based on the detection of the object manipulation gesture, the one or more processors determine a magnitude of a virtual force associated with the interaction, the one or more processors determine a feedback response to the interaction based on the magnitude of the virtual force and the object classification, the one or more processors output the feedback response, the one or more processors detect that a palm of the end user's hand is facing away from the electronic device, the one or more processors render one or more images corresponding with the first virtual object such that a first portion of the first virtual object is rendered and a second portion of the first virtual object that would be occluded by the end user's hand is not rendered in response to detecting that the palm of the end user's hand is facing away from the mobile device, the one or more processors cause a position of the first virtual object within the augmented reality environment to be snapped to a center of the end user's hand prior to rendering the one or more images in response to detecting the interaction with the first virtual object, the object manipulation gesture corresponds with a grabbing gesture; and a see-through display in communication with the one or more processors, the see-through display displays the one or more images of the first virtual object such that the first virtual object is perceived to exist within the augmented reality environment.