Local Erasure Codes for Data Storage

摘要

In some examples, an erasure code can be implemented to provide for fault-tolerant storage of data. Maximally recoverable cloud codes, resilient cloud codes, and robust product codes are examples of different erasure codes that can be implemented to encode and store data. Implementing different erasure codes and different parameters within each erasure code can involve trade-offs between reliability, redundancy, and locality. In some examples, an erasure code can specify placement of the encoded data on machines that are organized into racks.

主权项

1. A method comprising:
arranging data symbols into data groups; for each data group:
generating a group parity symbol; andincluding the group parity symbol in the data group; generating one or more global parity symbols, wherein the one or more global parity symbols are based on the data symbols; and recovering from failures, wherein the failures comprise:
up to a first failure associated with a data symbol or group parity symbol of each data group; andup to a number of additional failures associated with one or more of the data symbols, the group parity symbols, and the global parity symbols, wherein the number of additional failures is up to a number of the global parity symbols.