Detecting the Changing Position Of A Face To Move And Rotate A Game Object In A Virtual Environment

摘要

Methods for a mobile device with a front facing camera to use the detected position of the user's face as a game controller as well as a method of displaying the live streaming face within the video with audio within a virtual environment. Using a reference frame which serves as the origin, the subsequent frames of the live streaming video are used to calculate the change in position of the face detected within the video frame, and calculations of position, rotation, speed and distance are used to position a game object. Additionally this is a method for having a live video stream with live audio textured onto 2D/3D objects within a virtual environment with only the perspective cropped face displayed. This provides the appearance of the face as stable and unmoving even when the device's camera and/or user's face are moving relative to each other.

主权项

1. A method for rendering a face of a user onto a texture game object within a virtual environment, the method comprising:
creating a video stream from a front facing camera defined on a mobile device, wherein the video stream includes a face of a user performing a perspective crop on the video stream such that the face of the user is stabilized when the mobile device and camera are moving, to define a perspective-cropped face video stream; and rendering the perspective-cropped face video stream onto a texture of a two-dimensional or three-dimensional game object within a virtual environment.