Method and apparatus for distributed storage integrity processing

摘要

A distributed storage integrity system in a dispersed storage network includes a scanning agent and a control unit. The scanning agent identifies an encoded data slice that requires rebuilding, wherein the encoded data slice is one of a plurality of encoded data slices generated from a data segment using an error encoding dispersal function. The control unit retrieves at least a number T of encoded data slices needed to reconstruct the data segment based on the error encoding dispersal function. The control unit is operable to reconstruct the data segment from at least the number T of the encoded data slices and generate a rebuilt encoded data slice from the reconstructed data segment. The scanning agent is located in a storage unit and the control unit is located in the storage unit or in a storage integrity processing unit, a dispersed storage processing unit or a dispersed storage managing unit.

主权项

1. A storage integrity processing unit in a distributed storage network, comprises:
a network interface for interfacing with a plurality of storage units in the distributed storage network; and at least one rebuild module operable to:
receive a plurality of identifications of data slices that require rebuilding;store in a rebuild queue the plurality of identifications of data slices that require rebuilding;select one of the plurality of identifications of data slices from the rebuild queue based on a prioritization algorithm, wherein the selected data slice is one of an X number of a plurality of data slices of an encoded data segment and wherein the encoded data segment is one of a plurality of data segments of a data object and wherein the prioritization algorithm is based on a priority indicator associated with the data object;reconstruct the encoded data segment from at least a number T of the X number of the plurality of data slices of the encoded data segment to generate a reconstructed data segment; andgenerate a rebuilt encoded data slice corresponding to the selected data slice from the reconstructed data segment.