Method and system for reliable big capacity storage system protected by triple protection

摘要

The method delivers a storage system for Big Data usage. The system contains a matrix of unreliable physical data devices and data in this reliable big capacity storage system is protected by the triple protection so the method and system can protect storage system from more than 2 fault data devices. In some cases, the system can still deliver data when system has many failed data devices at the same. Floating Parity technology can also avoid heavily writing data to some device surfaces, due to parity update, which cause data device to be failed before expected device life time.

主权项

1. A method for providing row-parity-protection, column-parity-protection, and high-level-parity-protection in a big capacity storage system, the big capacity storage system having a plurality of big data devices, each of the plurality of big data devices having data devices arranged logically as rows and columns in an array, the method comprising:
selecting a floating row parity block from the data devices in each row of the array of each of the plurality of big data devices to store row parity data for the data devices in the respective row; selecting a floating column parity block from the data devices in each column of the array of each of the plurality of big data devices to store column parity data for the data devices in the respective column; and selecting a high-level parity block from the plurality of big data devices to store high-level parity data for the plurality of big data devices; wherein the row parity data are used to reconstruct data in a failed data device in the respective row; wherein the column parity data are used to reconstruct data in a failed data device in the respective column; and wherein the high-level parity data are used to reconstruct data in a failed big data device of the plurality of big data devices.