Hand tracker for device with display

摘要

An apparatus for remote hand control of a computer device, the apparatus comprising: a hand tracker, configured to track movement of a hand of a user of the computer device, an image presenter, associated with the hand tracker, configured to present a first image representative of the hand and a second image to the user, and to move the first image in concert with the tracked movement, and a computer controller, associated with the image presenter and configured to control the computer device in accordance with an interaction between the first image and the second image, thereby allowing the user to control the computer device, by moving the hand for bringing the first image and the second image into the interaction.

主权项

1. A computer implemented method comprising:
obtaining a time series of images of a hand of a user of a computer device, the hand projected with a light structured in a pattern that enables tracking the hand, the pattern of the structured light comprises a plurality of stripes arranged substantially in parallel to each other forming a continuous feature of the structured light; detecting segmentation of the stripes based on changes in intensity profiles of light reflected from the hand along the continuous feature; tracking a movement of the hand using the images by identifying, in the pattern of the structured light, at least one cluster of stripe segments created by the segmentation of the stripes by at least one part of the hand and tracking the at least one cluster of stripe segments; presenting, on a display of the computer device, a first image representative of the hand and a second image representative of an interface of a computer application running on the computer device; moving the first image in concert with the tracked movement of the hand; detecting an interaction between the first image and the second image, the interaction represented by the first image with respect to the second image on the display of the computer device; and invoking a functionality of the computer application based on the detected interaction.