MEMORY ELEMENT FOR A NEURAL NETWORK

摘要

A system includes a number of different long short term memory (LSTM) elements, in which the input value of each LSTM element is gated by a different number of input control signals. In addition, each LSTM element may also include a state feed-back path in which the current state is weighted by a function of a product of one or more memory control values.

主权项

1. A memory element receiving an input value and providing an output value, comprising:
a first multiplicative element receiving the input value, a plurality of input control values and providing a resulting input value that is a function of a product of the input value and the input control values; a state element providing a state value at each time point, wherein the state value assumes a first value at a first time point, and assumes a second value at a second time point immediately following the first time point, the second value being derived from a sum of the resulting input value and a function of the first value; and a second multiplicative element receiving the state value of the state element and a third control value, and providing the output value as a function of a product of the state value and the third control value.