ERASURE-CODING EXTENTS IN AN APPEND-ONLY STORAGE SYSTEM

摘要

A data storage system stores sets of data blocks in extents located on storage devices. During operation, the system performs an erasure-coding operation by obtaining a set of source extents, wherein each source extent is stored on a different machine in the data storage system. The system also selects a set of destination machines for storing destination extents, wherein each destination extent is stored on a different destination machine. Next, the system performs the erasure-coding operation by retrieving data from the set of source extents, performing the erasure-coding operation on the retrieved data to produce erasure-coded data, and then writing the erasure-coded data to the set of destination extents on the set of destination machines. Finally, after the erasure-coding operation is complete, the system commits results of the erasure-coding operation to enable the set of destination extents to be accessed in place of the set of source extents.

主权项

1. A computer-implemented method, comprising:
operating a data storage system that stores sets of data blocks in extents that are located in storage devices, wherein operating the data storage system involves performing an erasure-coding operation by: obtaining a set of source extents to be erasure-coded; selecting a set of destination machines for storing a set of destination extents to during the erasure-coding operation, wherein each destination extent in the set of destination extents is stored on a different machine in the set of destination machines; initializing the set of destination extents on the set of destination machines; performing the erasure-coding operation by,
retrieving data from the set of source extents,performing an erasure-coding operation on the retrieved data to produce erasure-coded data, andwriting the erasure-coded data to the set of destination extents on the set of destination machines; and after the erasure-coding operation is complete, committing results of the erasure-coding operation to enable the set of destination extents to be accessed in place of the set of source extents.