MOTION CONTROL OF A VIRTUAL ENVIRONMENT

摘要

An optical flow of depth video of a depth camera imaging a human subject is recognized. An energy field created by motion of the human subject is generated as a function of the optical flow and specified rules of a physical simulation of the virtual environment. The energy field is mapped to a virtual position in the virtual environment. A property of a virtual object in the virtual environment is adjusted based on a plurality of energy elements of the energy field in response to the virtual object interacting with the virtual position of the energy field.

主权项

1. A computer-implemented method for controlling a virtual environment, comprising:
recognizing a virtual skeleton that models a human subject with a plurality of virtual joints characterized by three-dimensional positions, the virtual skeleton derived from depth video of a depth camera imaging the human subject; using the virtual skeleton to identify a gesture performed by the human subject; recognizing an optical flow of the depth video, the optical flow derived from a plurality of cells mapped to the depth video, each cell having a motion value indicating a magnitude of motion in that cell recognized between consecutive image frames of the depth video; using the optical flow to assign a magnitude to the gesture performed by the human subject; and controlling a property of the virtual environment as a function of the gesture and the magnitude.