| 摘要 |
Technology is disclosed for a data storage architecture for providing enhanced storage resiliency for a data object. The data storage architecture can be implemented in a single-tier configuration and/or a multi-tier configuration. In the single-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data fragments, which are stored across many storage devices. In the multi-tier configuration, a data object is encoded, e.g., based on an erasure coding method, to generate many data segments, which are sent to one or more tiers of storage nodes. Each of the storage nodes further encodes the data segment to generate many data fragments representing the data segment, which are stored across many storage devices associated with the storage node. The I/O operations for rebuilding the data in case of device failures is spread across many storage devices, which minimizes the wear of a given storage device. |
| 主权项 |
1. A computer-implemented method comprising:
obtaining, at a storage management computer node of a storage management system, historical information regarding a failure rate of a storage device, the storage device being of a type of multiple storage devices associated with the storage management system, the storage management computer node encoding a data object to generate a first specified number of encoded data segments, the encoded data segments stored at multiple storage computer nodes, the first specified number of encoded data segments including a second specified number of redundant encoded data segments, which are generated to provide a storage resiliency to the data object, the first specified number being a function of the second specified number; determining, using the storage management computer node, predicted information regarding a failure rate of the storage devices based on the historical information; determining, using the storage management computer node, a lifespan of the storage devices as a function of the historical information and the predicted information; determining, by the storage management computer node, a statistical probability of a loss of a storage computer node of the storage computer nodes over the lifespan of the storage devices; and determining, by the storage management computer node, the second specified number of the redundant encoded data segments to be generated based on the statistical probability. |
