SYSTEMS AND METHODS FOR FINGER POSE ESTIMATION ON TOUCHSCREEN DEVICES

摘要

Described are systems and methods for estimating finger pose of a user during a tactile input event. In one implementation, the system incorporates: a touch-sensitive display device configured to detect a tactile event and to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event; a camera configured to capture an image of an area proximal to the surface of the touch-sensitive display device; and a central processing unit configured, in response to the detection of the tactile event, to determine information on a pose of the object based on the captured image and the determined contact point.

主权项

1. A computer-implemented method performed in a computerized system comprising a central processing unit, a touch-sensitive display device, a memory and a camera, the computer-implemented method comprising:
a. using the touch-sensitive display device to detect a tactile event; b. using the camera to capture an image of an area proximal to the surface of the touch-sensitive display device; c. using the touch-sensitive display device to determine a contact point of an object and the touch-sensitive display device, the contact point associated with the tactile event; and d. responsive to the detection of the tactile event, using the central processing unit to determine information on a pose of the object based on the captured image and the determined contact point.