Selective hand occlusion over virtual projections onto physical surfaces using skeletal tracking

摘要

A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include performing operations for capturing an image of a scene in which a virtual object is to be displayed, recognizing a body part present in the captured image, and adjusting a display of the virtual object based upon the recognized body part. The rendering operations may also include capturing an image with a body mounted camera, capturing spatial data with a body mounted sensor array, recognizing objects within the captured image, determining distances to the recognized objects within the captured image, and displaying the virtual object on a head mounted display.

主权项

1. A method of rendering images in an augmented reality system, comprising:
capturing an image of a scene, in which a virtual object is to be displayed; recognizing, via a computing device, a body part present in the captured image; determining, via the computing device, and in response to the recognizing, whether the body part belongs to a first individual or a second individual; displaying, via the computing device, the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying, via the computing device, the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual.