Grouping of Objects in a Distributed Storage System Based on Journals and Placement Policies

摘要

Managing placement of object replicas is performed at a first instance of a distributed storage system. One or more journals are opened for storage of object chunks. Each journal is associated with a single placement policy. A first object is received comprising at least a first object chunk. The first object is associated with a first placement policy. The first object chunk is stored in a first journal whose associated placement policy matches the first placement policy. The first journal stores only object chunks for objects whose placement policies match the first placement policy. For the first journal, the receiving and storing operations are repeated for multiple objects whose associated placement policies match the first placement policy, until a first termination condition occurs. Then, the first journal is closed. Subsequently, the first journal is replicated to a second instance of the distributed storage system according to the first placement policy.

主权项

1. A method for managing placement of object replicas in a distributed storage system, comprising:
at a first instance of the distributed storage system, having one or more processors and memory, wherein the memory stores a plurality of objects and one or more programs for execution by the one or more processors: opening one or more journals for storage of object chunks, wherein each journal is associated with a single respective placement policy; receiving a first object comprising at least a first object chunk, wherein the first object is associated with a first placement policy; storing the first object chunk in a first journal whose associated placement policy matches the first placement policy, wherein the first journal stores only object chunks for objects whose placement policies match the first placement policy; for the first journal, repeating the receiving and storing operations for a first plurality of objects whose associated placement policies match the first placement policy, until a first termination condition occurs; after the first termination condition occurs, closing the first journal, thereby preventing any additional object chunks from being stored in the first journal; and replicating the first journal to a second instance of the distributed storage system in accordance with the first placement policy.