Systems and methods for parallel batch processing of write transactions

摘要

A system and method is provided for parallel processing of multiple write requests to write data associated the multiple write requests to a storage area concurrently. The file system receives a series of write request from one more applications executing on the computing device. The file system includes one or more processing modules that selectively groups writes request into lists or trains. After the processing modules begin processing first threads associated with writes in a first train, the processing modules determines whether and when to initiate processing of second threads associated with writes in a second train during processing of the first threads.

主权项

1. A system for processing two or more write requests in parallel, the system comprising:
at least one processor; a file system executing on the at least one processor to receive a series of write requests from at least one application being executed by the at least one processor, each write request comprising detail data and a thread for writing data; and at least one processing module executed by the file system in response to the series of write requests to:
determine whether a first transaction list is eligible for processing based on at least one first thread processing attribute associated with the first transaction list, the first transaction list comprising a first one or more corresponding transaction records each identifying first corresponding detail data and a first corresponding thread;execute the first corresponding thread for the first one or more corresponding transaction records to write the first corresponding detail data to a first at least one allocated block when the first transaction list is eligible for processing;determine whether a second transaction list is eligible for processing based on the at least one first thread processing attribute and at least one second thread processing attribute associated with the second transaction list, the second transaction list comprising a second one or more corresponding transaction records each identifying second corresponding detail data and a second corresponding thread; andexecute the second corresponding thread for the second one or more corresponding transaction records during execution of the first corresponding thread to write the second corresponding detail data to a second at least one allocated block when the second transaction list is eligible for processing.