| 主权项 |
1. A method for backing up at least part of a file system represented by a tree structure, the method comprising:
distributing work to workers to walk parts of the tree structure in a parallel tree walk, the workers generating multiple streams; writing file system data for backing up the at least part of the file system represented by the tree structure to data storage devices in parallel streams of the multiple streams, distributing the work to the workers comprises: identifying a work item assigned to a first worker; and splitting the work item assigned to the first worker between the first worker and a second worker based on whether the second worker is idle and whether a data storage device is idle, wherein splitting the work item comprises identifying an intermediary hash value, assigning the first worker a first set of hash values to process based on the intermediary hash value, and assigning the second worker a second set hash to process based on the intermediary hash value, wherein the first set of hash values and the second set of hash values each comprises a respective minimum hash value and a respective maximum hash value; and persisting relationship data that maintains relationships between the streams and location data that maintains storage locations of the streams, further comprising: assigning a first stream identifier to the first stream; assigning a second stream identifier to the second stream; and inserting a reference to the second stream identifier into the first stream. |
