主权项 |
1. A computer-implemented method for scoring operations, comprising:
setting up, via an execution core, a scoring operation associated with a plurality of vector data types on a plurality of direct memory access engines on a stream-by-stream basis where a single vector data stream associated with a corresponding single vector data type is set up for processing via a corresponding single direct memory access engine; consuming, via the execution core, vector data stored in a plurality of data buffers during the scoring operation, wherein the vector data is consumed in a stream-by-stream basis; transferring, between the data buffers and the direct memory access engines, an indication that a given buffer associated with a given stream is has a certain fullness, wherein the transfer between the data buffers and the direct memory access engines is on a stream-by-stream basis; and throttling, via the direct memory access engines, data requests so as to stop and/or start such data requests in response to the indication from the data buffers that a given buffer associated with a given stream has a certain fullness, wherein the throttling is on a stream-by-stream basis. |