Distributed Shared Log For Modern Storage Servers

摘要

Disclosed herein are system, method, and computer program product embodiments for accessing a distributed shared log that supports a total order over log writes and multiple logical log streams. An embodiment operates by selecting a range of log entries for a logical log stream from the distributed shared log and mapping the selected range of log entries to associated storage units in a plurality of storage units. The selected range of log entries are stored at the associated storage units according to metadata that indexes the selected range of log entries by logical log stream. The selected range of log entries are then requested from the associated storage units based on the mapping. The selected range of log entries for the logical log stream are then returned from the associated storage units based on a scan of the metadata. The received log entries are then reassembled.

主权项

1. A computer implemented method for accessing a distributed shared log, comprising:
selecting, by at least one processor, a range of log entries for a logical log stream from the distributed shared log, the distributed shared log being distributed over a plurality of storage units, the distributed shared log associated with a plurality of logical log streams, and the distributed shared log providing ordered writes across the plurality of logical log streams; mapping, by the at least one processor, the selected range of log entries to associated storage units in the plurality of storage units; requesting, by the at least one processor, the selected range of log entries from the associated storage units based on the mapping, wherein the selected range of log entries are stored according to metadata at the associated storage units; receiving, by the at least one processor, the selected range of log entries from the associated storage units based on the requesting; and reassembling, by the at least one processor, the received selected range of log entries for the logical log stream.