NATURAL MOTION-BASED CONTROL VIA WEARABLE AND MOBILE DEVICES

摘要

A “Natural Motion Controller” identifies various motions of one or more parts of a user's body to interact with electronic devices, thereby enabling various natural user interface (NUI) scenarios. The Natural Motion Controller constructs composite motion recognition windows by concatenating an adjustable number of sequential periods of inertial sensor data received from a plurality of separate sets of inertial sensors. Each of these separate sets of inertial sensors are coupled to, or otherwise provide sensor data relating to, a separate user worn, carried, or held mobile computing device. Each composite motion recognition window is then passed to a motion recognition model trained by one or more machine-based deep learning processes. This motion recognition model is then applied to the composite motion recognition windows to identify a sequence of one or more predefined motions. Identified motions are then used as the basis for triggering execution of one or more application commands.

主权项

1. A computer-implemented process, comprising:
constructing a composite motion recognition window by concatenating an adjustable number of sequential periods of inertial sensor data received from one or more separate sets of inertial sensors, each separate set of inertial sensors being coupled to a separate one of a plurality of user worn control devices; passing the composite motion recognition window to a motion recognition model trained by one or more machine-based deep learning processes; applying the motion recognition model to the composite motion recognition window to identify a sequence of one or more predefined motions of one or more user body parts; and triggering execution of a sequence of one or more application commands in response to the identified sequence of one or more predefined motions, thereby increasing user interaction performance and efficiency by enabling users to interact with computing devices by performing body part motions.