Systems and methods for initializing motion tracking of human hands

摘要

Systems and methods for initializing motion tracking of human hands are disclosed. One embodiment includes a processor; a reference camera; and memory containing: a hand tracking application; and a plurality of edge feature templates that are rotated and scaled versions of a base template. The hand tracking application configures the processor to: determine whether any pixels in a frame of video are part of a human hand, where a part of a human hand is identified by searching the frame of video data for a grouping of pixels that have image gradient orientations that match the edge features of one of the plurality of edge feature templates; track the motion of the part of the human hand visible in a sequence of frames of video; confirm that the tracked motion corresponds to an initialization gesture; and commence tracking the human hand as part of a gesture based interactive session.

主权项

1. A real-time gesture based interactive system, comprising:
a processor; a reference camera configured to capture sequences of frames of video data, where each frame of video data comprises intensity information for a plurality of pixels; memory containing: a hand tracking application; and a set of edge feature templates comprising a plurality of edge feature templates that are rotated and scaled versions of a base template; wherein the hand tracking application configures the processor to: obtain a sequence of frames of video data from the reference camera; compare successive frames of video data from the sequence of frames of video data for pixels that are moving; determine whether any of the pixels that changed are part of a human hand visible in the sequence of frames of video data, where a part of a human hand is identified by searching the frame of video data for a grouping of pixels that have image gradient orientations that match the edge features of one of the plurality of edge feature templates; and track the motion of the part of the human hand visible in the sequence of frames of video data; confirm that the tracked motion of the part of the human hand visible in the sequence of frames of video data corresponds to a predetermined initialization gesture, wherein the predetermined initialization gesture comprises a finger oscillating from side to side within a predetermined gesture range; and commence tracking the human hand as part of a gesture based interactive session.