System and method for object integrity service

摘要

An embodiment for object integrity service in a storage system includes generating a list of objects stored in a storage system, wherein the list of objects may list an unchecked object, and wherein the unchecked object is an object that has not been checked within a set time period, walking through the list of objects to identify the unchecked object, adding a task to a queue to check the unchecked object, and clearing the task from the queue by checking the unchecked object.

主权项

1. A method for data integrity checks comprising:
running an object integrity service (OIS) on a processor within a storage system, wherein the OIS is a background process and wherein the running the OIS comprises:
maintaining a list of objects stored in the storage system and a respective time each object was last scanned;repeatedly visiting, by a visitor process, the list of objects to search for an object needing to be scanned, wherein the object needing to be scanned has a respective time the object was last scanned that exceeds a set timeframe;generating, by the visitor process, a task in a message queue to scan the object needing to be scanned without scanning the object needing to be scanned for errors, wherein the message queue has a maximum size;performing, by a data scrubber process, the task in the message queue by scanning the object needing to be scanned for errors, wherein the data scrubber process runs independently from the visitor process;removing the task from the message queue after performing the task in the message queue; andreturning to a start of the list of objects, by the visitor process, to search for one or more additional objects needing to be scanned when the message queue reaches the maximum size, wherein the one or more additional objects needing to be scanned each has a respective time the object was last scanned that exceeds the set timeframe.