SYSTEM AND METHODS FOR ON-BODY GESTURAL INTERFACES AND PROJECTION DISPLAYS

摘要

A wearable system with a gestural interface for wearing on, for instance, the wrist of a user. The system comprises an ultrasonic transceiver array structure and may comprise a pico projector display element for displaying an image on a surface. User anatomical feature inputs are received in the form of ultrasound signals representative of a spatio-temporal cross-section of the wrist of the user by articulating wrist, finger and hand postures, which articulations are translated into gestures. Inputs from inertial and other sensors are used by the system as part of the anatomical feature posture identification method and device. Gestures are recognized using a mathematically-modeled, simulation-based set of biological metrics of tissue objects, which gestures are converted to executable computer instructions. Embodiments of the system disclosed herein may also be used to monitor biometric and health data over computer networks or using onboard systems.

主权项

1. A method for generating a gesture command using a wearable gesture recognition device in a human-computer interface system comprising the steps of:
providing a mathematical model based on a rigid body motion of the wearable gesture recognition device and on a set of biological metrics of a plurality of predetermined internal or external objects of an anatomical feature; obtaining a set of ultrasound signal data from the anatomical feature of a user of the plurality of objects by mapping a spatio-temporal cross-section of the anatomical feature of the user; identifying a predetermined property of the objects by correlating the ultrasound signal data with the mathematical model; estimating a posture of the user's anatomical feature based on the identified property of the objects; and generating a gesture command based on the estimated posture.