NEURAL PROCESSING UNIT THAT SELECTIVELY WRITES BACK TO NEURAL MEMORY EITHER ACTIVATION FUNCTION OUTPUT OR ACCUMULATOR VALUE

摘要

A neural network unit includes a programmable indicator, a first memory that holds first operands, a second memory that holds second operands, neural processing units (NPU), and activation units. Each NPU has an accumulator and an arithmetic unit that performs a series of multiply operations on pairs of the first and second operands received from the first and second memories to generate a series of products, and a series of addition operations on the series of products to accumulate an accumulated value in the accumulator. The activation units perform activation functions on the accumulated values in the accumulators to generate results. When the indicator specifies the first action, the neural network unit writes to the first memory the results generated by the activation units. When the indicator specifies the second action, the neural network unit writes to the first memory the accumulated values in the accumulators.

主权项

1. A neural network unit, comprising:
a programmable indicator that specifies first and second actions; a first memory that holds first operands; a second memory that holds second operands; a plurality of neural processing units (NPU) each having:
an accumulator; andan arithmetic unit that performs a series of multiply operations on pairs of the first and second operands received from the first and second memories to generate a series of products, the arithmetic unit also performs a series of addition operations on the series of products to accumulate an accumulated value in the accumulator; a plurality of activation units that perform activation functions on the accumulated values in the accumulators to generate results; when the indicator specifies the first action, the neural network unit writes to the first memory the results generated by the plurality of activation units; and when the indicator specifies the second action, the neural network unit writes to the first memory the accumulated values in the accumulators.