High throughput hardware acceleration using pre-staging buffers

摘要

Embodiments relate to providing high throughput hardware acceleration. Aspects include initializing an accelerator control queue (ACQ) configured to provide location information on a plurality of pages of data identified as accelerator data. An originating location of each page of requested target data is determined. The originating location includes one of system memory and disk storage. Based on determining that the originating location is system memory, an entry is created in the ACQ mapping to a system memory source address for the target data. Based on determining that the originating location is disk storage, an entry is created in the ACQ mapping to a special pre-stage buffer source address of a special pre-stage buffer for the target data. Each page of the plurality of pages of target data is accessed by the accelerator from respective locations in said memory or said special pre-stage buffer, based on respective entries of the ACQ.

主权项

1. A computer-implemented method for providing high throughput hardware acceleration, comprising:
initializing, by a computer, an accelerator control queue (ACQ) configured to provide location information on a plurality of pages of data identified as accelerator data; receiving a request for a target data from a software application, the target data spanning a plurality of pages; determining an originating location of each page of the target data, the originating location comprising at least one of a system memory and a disk storage; based on determining that the originating location is the system memory, creating an entry in the ACQ that maps to a system memory source address for the target data; based on determining that the originating location is the disk storage, creating an entry in the ACQ that maps to a pre-stage buffer source address of special pre-stage buffers for the target data, the special pre-stage buffers configured to pre-stage the target data from the disk storage for access by accelerators; wherein the special pre-stage buffers include accelerator buffers; and accessing, by the accelerators, each page of the plurality of pages of the target data from respective locations in the system memory or the special pre-stage buffers, based on respective entries of the ACQ; wherein the accelerators each comprise one of the special pre-stage buffers; wherein the accelerators are connected to the system memory and the disk storage by an I/O network, the system memory and the disk storage both being external to the accelerators; wherein at least one of the accelerators is connected to the system memory by a dedicated interface separate from the I/O network; and wherein another one of the accelerators is separately connected to an additional special pre-stage buffer.