Multiple erasure codes for distributed storage

摘要

Embodiments relate to a system with multiple erasure codes, and selecting and encoding for a write file with one of the codes to mitigate costs associated with storage recovery. The codes include a fast recovery code for frequently accessed data and a higher storage efficiency code for less frequently accessed data. State data is tracked to ascertain frequency of access to the file. One of the erasure codes is dynamically selected based on the tracked data, with the focus of the code select to lower recovery costs, and the data is encoded with the selected erasure code. Accordingly, the original coding of the write file is subject to change based on the tracked state data.

主权项

1. A method for dynamically selecting an erasure code in a storage system, comprising:
tracking a state of data access; adaptively selecting between at least two erasure codes based on the tracked data access state, including a fast recovery code for frequently accessed data and a higher storage efficiency code for less frequently accessed data; dynamically converting between the at least two erasure codes based on a global state; dynamically converting a set of one or more fast erasure coded files to a compact erasure code responsive to the global state exceeding a threshold or the tracked data access state demonstrating a decrease; and encoding the data with the selected erasure code.