Grasping virtual objects in augmented reality

摘要

An augmented reality system which enables grasping of virtual objects is described such as to stack virtual cubes or to manipulate virtual objects in other ways. In various embodiments a user's hand or another real object is tracked in an augmented reality environment. In examples, the shape of the tracked real object is approximated using at least two different types of particles and the virtual objects are updated according to simulated forces exerted between the augmented reality environment and at least some of the particles. In various embodiments 3D positions of a first one of the types of particles, kinematic particles, are updated according to the tracked real object; and passive particles move with linked kinematic particles without penetrating virtual objects. In some examples a real-time optic flow process is used to track motion of the real object.

主权项

1. A computing device arranged to calculate a virtual object in a virtual reality environment, the computing device comprising:
an input arranged to receive a plurality of images of at least part of a real object in an interaction volume associated with the virtual reality environment; a 3D tracker arranged to track 3D motion and/or deformation of a surface of the real object in the interaction volume using the received images and approximate the surface of the real object by filling the contour of the real object with a plurality of non-intersecting passive particles, wherein each passive particle is linked to one of a plurality of kinematic particles; and a physics simulator arranged to calculate the position of the virtual object in the virtual reality environment according to simulated forces between the virtual object and the real object, the simulated forces being determined at least using the tracked 3D motion and/or deformation, the plurality of passive particles, and the plurality of kinematic particles, wherein the simulated forces are determined such that the passive particles cannot penetrate the virtual object or the other passive particles.