Speeding learning in neural networks

摘要

A method of accelerating the training of an artificial neural network uses a computer configured as an artificial neural network with a network input and a network output, and having a plurality of interconnected units arranged in layers including an input layer and an output layer. Each unit has a multiplicity of unit inputs and a set of variables for operating upon a unit inputs to provide a unit output. A plurality of examples are serially provided to the network input and the network output is observed. The computer is programmed with a back propagation algorithm for adjusting each set of variables in response to feedback representing differences between the network output for each example and the desired output. The examples are iterated until the signs of the outputs of the units of the output layer converge. Then each set of variables is multiplied by a multiplier. The examples are reiterated until the magnitude of the outputs of the units of the output layer converge.