Rendition of 3D content on a handheld device

摘要

A handheld device having a display and a front-facing sensor and a back-facing sensor is able to render 3D content in a realistic and spatially correct manner using position-dependent rendering and view-dependent rendering. In one scenario, the 3D content is only computer-generated content and the display on the device is a typical, non-transparent (opaque) display. The position-dependent rendering is performed using either the back-facing sensor or a front-facing sensor having a wide-angle lens. In another scenario, the 3D content is composed of computer-generated 3D content and images of physical objects and the display is either a transparent or semi-transparent display where physical objects behind the device show through the display. In this case, position-dependent rendering is performed using a back-facing sensor that is actuated (capable of physical panning and tilting) or is wide-angle, thereby enabling virtual panning.

主权项

1. A method of rendering computer-generated content on a handheld device, comprising:
creating user-tracking data by tracking user face information, wherein the user-tracking data comprises information relating a position and an orientation of a user face relative to the handheld device; creating device-position data by determining a position of the handheld device, wherein the device-position data comprises information relating to an orientation of the handheld device relative to a physical environment the handheld device is situated; calculating rendering data using the user-tracking data and the device-position data; and displaying the computer-generated content on the handheld device according to the rendering data, wherein rendering of the computer-generated content is adjusted based on user movement relative to the handheld device and handheld device movement relative to the physical environment the handheld device is situated.