Object store management operations within compute-centric object stores

摘要

Object store management operations within compute-centric object stores are provided herein. An exemplary method may include transforming an object storage dump into an object store table by a table generator container, wherein the object storage dump includes at least objects within an object store that are marked for deletion, transmitting records for objects from the object store table to reducer containers, such that each reducer container receives object records for at least one object, the object records comprising all object records for the at least one object, generating a set of cleanup tasks by the reducer containers, and executing the cleanup tasks by a cleanup agents.

主权项

1. A method, comprising:
partitioning raw usage records by a map phase container; grouping the partitioned records by user, type, and an identifier via a first set of reducer containers; deduplicating the grouped usage records via a second set of reducer containers; aggregating the deduplicated usage records for a user for a namespace into namespace records via the second set of reducer containers; and summing namespace records for each namespace associated with the user into a usage report via a third set of reducer containers.