Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment

摘要

An electronic system for integrating a user's moving image into a computer-generated pictorial environment, and allowing the user to interact with the environment and objects therein. The environment is rendered on a screen display in a manner that simulates three dimensions, including respect for occlusion relationships among the user and objects in the environment. The resulting image, which changes as the user gestures and interacts with the environment, is projected onto a large screen that the user faces. The environment includes a series of mobile entities, or "agents," which respond to one or more of the user's changing position, gestures and voice, exhibiting context-dependent behavior that appears semi-intelligent.