SYSTEMS AND METHODS FOR REMAPPING THREE-DIMENSIONAL GESTURES ONTO A FINITE-SIZE TWO-DIMENSIONAL SURFACE

摘要

A method for operating a real-time gesture based interactive system includes: obtaining a sequence of frames of data from an acquisition system; comparing successive frames of the data for portions that change between frames; determining whether any of the portions that changed are part of an interaction medium detected in the sequence of frames of data; defining a 3D interaction zone relative to an initial position of the part of the interaction medium detected in the sequence of frames of data; tracking a movement of the interaction medium to generate a plurality of 3D positions of the interaction medium; detecting movement of the interaction medium from inside to outside the 3D interaction zone at a boundary 3D position; shifting the 3D interaction zone relative to the boundary 3D position; computing a plurality of 2D positions based on the 3D positions; and supplying the 2D positions to control an application.

主权项

1. A real-time gesture based interactive system comprising:
a processor; an acquisition system configured to capture a sequence of frames of data for constructing a depth map of a field of view of the acquisition system; memory storing an interaction medium tracking application, the interaction medium tracking application configuring the processor to:
obtain the data from the acquisition system;compare successive frames of the frames of data for portions that change from one frame to the next;determine whether any of the portions that changed are part of an interaction medium detected in the sequence of frames of data;define an inner 3D interaction zone relative to an initial position of the part of the interaction medium detected in the sequence of frames of data, where the inner 3D interaction zone corresponds to a bounded region that is less than the frame of data and that contains the part of the interaction medium detected in the sequence of frames of data;track a movement of the interaction medium in the data to generate a plurality of 3D positions of the interaction medium;detect movement of the interaction medium from inside to outside the inner 3D interaction zone at a boundary 3D position;shift the inner 3D interaction zone relative to the boundary 3D position;compute a plurality of computed positions based on the 3D positions; andsupply the computed positions to control an application.