Multi-Modal Neural Interfacing for Prosthetic Devices

摘要

Methods and systems to interface between physiological devices and a prosthetic device, including to receive a plurality of types of physiological activity signals from a user, decode a user movement intent from each of the plurality of signals types, and fuse the movement intents into a joint decision to control moveable elements of the prosthetic device.

主权项

1. A method for controlling a prosthetic device, the method comprising:
receiving, by a plurality of types of sensors, a plurality of types of physiological activity signals from a prosthetic device user; classifying, by a plurality of classifier modules, user movement states from each of the plurality of types of physiological activity signals, wherein each classifier module of the plurality of classifier modules is associated with a corresponding type of physiological activity signal; decoding, by a plurality of decoders, movement intents from each of the plurality of types of physiological activity signals and from one or more of the user movement states, wherein each decoder of the plurality of decoders is associated with a corresponding type of physiological activity signal; and fusing, by a fusion module, the movement intents into a joint movement decision, wherein the plurality of types of physiological activity signals include a combination of two or more of: a local field potential (LFP) signal, a unit activity (spike) signal, an epidural electrocorticography grid (ECoG) signal, an electromyography (EMG) signal, an electroencephalography (EEG) signal, and an electronystagmography (ENG) signal.