Method and system for parallelizing database requests

摘要

Methods and systems are described for applying the use of shards within a single memory address space. A database request is processed by providing the request from a client to a processor, the processor then distributing the request to multiple threads within a single process but executing in a shared memory address environment, wherein each thread performs the request on a distinct shard, and aggregating the results of the multiple threads being aggregated and returning a final result to the client. By parallelizing operations in this way, the request response time can be reduced and the total amount of communication overhead can be reduced.

主权项

1. A method comprising:
storing, by a plurality of threads of a common process running on a computing device, a plurality of separate data subsets in a common address space assigned to the common process in a semiconductor memory of the computing device; wherein the plurality of threads does not share access to the plurality of separate data subsets even though the plurality of separate data subsets are stored in the common address space; wherein communication between the plurality of threads of the common process is accomplished by storing messages in the common address space; receiving a database request; transforming the database request into a plurality of sub-requests; executing the plurality of sub-requests by the plurality of threads wherein execution of a particular sub-request of the plurality of sub-requests is performed on a particular separate data subset of the plurality of separate data subsets by a particular thread of the plurality of threads of the common process that stores the particular separate data subset; producing a final result set by aggregating a plurality of intermediate result sets generated and stored in the common address space by the plurality of threads; wherein the method is performed by the computing device.