SORTING DATABASE COLLECTIONS FOR PARALLEL PROCESSING

摘要

Techniques are described for assigning collections of records to parallel processing tasks for sorting index keys of the records. In one example, a method includes determining an order of the collections of records in a descending order by byte length of an index key of each of the collections of records. The method further includes modifying the order of the collections of records in a descending order, for collections of records with index keys of equal byte length, by number of records per collection of each of the collections of records with index keys of same byte length. The method further includes assigning the collections of records to a plurality of parallel processing tasks in the order of the collections of records. The method may combine low elapsed processing times by balancing the amount of work in each assigned processing task with reduced computing resource overhead for each processing task.

主权项

1. A method of assigning collections of records to parallel processing tasks for sorting index keys of the records, the method comprising:
determining, by a computing device, an order of collections of records based on a length of an index key for each of the collections of records; for subsets of the collections of records identified as having index keys of equal length, modifying, by the computing device, the order of the collections of records within the identified subsets based on a number of records per collection; and assigning, by the computing device, the collections of records to a plurality of parallel processing tasks based on the order of the collections of records.