摘要 |
The present technology refers to methods for dynamic determining location and orientation of handheld device, such as a smart phone, remote controller or gaming device, within a 3D environment in real time. For these ends, there is provided a 3D camera for capturing a depth map of the 3D environment within which there is a user holding the handheld device. The handheld device acquires motion and orientation data in response to hand gestures, which data is further processed and associated with a common coordinate system. The depth map is also processed to generate motion data of user hands, which is then dynamically compared to the processed motion and orientation data obtained from the handheld device so as to determine the handheld device location and orientation. The positional and orientation data may be further used in various software applications to generate control commands or perform analysis of various gesture motions. |