Pinch And Hold Gesture Navigation On A Head-Mounted Display

摘要

A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

主权项

1. A system including:
a head-mounted display (HMD) configured to be worn by a user; a glove configured to be worn by a hand of the user, the glove having finger segments for each finger of the hand, each finger segment includes a sensor for detecting positions of the finger segment when moved by the hand; one or more cameras for capturing images of the HMD and images of the glove; a computing device connected to the one or more cameras and interfaced with the HMD and the glove, wherein the computing device is configured to analyze data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments, wherein the computing device is configured for generating image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated, wherein while the pinch and hold gesture is active, the computing device is configured for coupling movement of the glove with movement of the scene, such that the scene moves with detected movement of the glove.