Deep augmented reality tags for mixed reality

摘要

Techniques are provided for rendering, in a see-through, near-eye mixed reality display, a virtual object within a virtual hole, window or cutout. The virtual hole, window or cutout may appear to be within some real world physical object such as a book, table, etc. The virtual object may appear to be just below the surface of the physical object. In a sense, the virtual world could be considered to be a virtual container that provides developers with additional locations for presenting virtual objects. For example, rather than rendering a virtual object, such as a lamp, in a mixed reality display such that appears to sit on top of a real world desk, the virtual object is rendered such that it appears to be located below the surface of the desk.

主权项

1. A method comprising:
determining, by an electronic system, a location for a virtual container with respect to a real world object in a real world environment, including determining a location for a cutout in a surface of the real world object and determining a location for a virtual container below the cutout, wherein the surface of the real world object comprises a surrounding region outside of the cutout; accessing, by the electronic system, a location of a virtual object within the virtual container; determining, by the electronic system, a location of a user wearing a see-through, near-eye, mixed-reality display device; determining, by the electronic system, what portion of the virtual object within the virtual container should be visible from the perspective of the user, including determining where the virtual container occludes a portion of the virtual object from the perspective of the user; and rendering, in the see-through, near-eye, mixed-reality display device, the virtual object within the virtual container to present an illusion that the virtual object is within the virtual container, including rendering the cutout in the surface of the real world object, rendering the virtual object to appear to be at the location in the virtual container and to be below the surface of the real world object from the perspective of the user, showing portions of the virtual object that would be visible from the perspective of the user seeing into the cutout, and occluding portions of the virtual object that would not be visible through the cutout from the perspective of the user, wherein the occluding includes occluding portions of the virtual object that are blocked by the surrounding region from the perspective of the user, wherein the showing includes not occluding any portion of the virtual object by the surrounding region when the perspective of the user allows the user to see the virtual object through the cutout without the surrounding region blocking any portion of the virtual object.