MULTIPLE TRANSACTION LOGS IN A DISTRIBUTED STORAGE SYSTEM

摘要

In various embodiments, methods and systems for implementing multiple transaction logs in a distributed storage system are provided. A log stream component detects performance metrics of a plurality of log streams. The performance metrics are associated with requests from partitions in the distributed storage system. A transaction component receives a request to execute a transaction using a log stream. The request is received from a partition of the distributed storage system. The performance metrics of the plurality of log streams can be referenced, where the performance metrics indicate a performance capacity of a selected log stream to process the request. A log stream for executing the transaction is determined based on the performance capacity. The log stream selected can also factor request attributes of the request. The transaction component communicates the request to be executed, using the log stream to perform the transaction.

主权项

1. A system for implementing multiple log streams in distributed storage systems, the system comprising:
a stream component configured for:
detecting performance metrics of a plurality of log streams, wherein the performance metrics are based on processing requests from partitions in a distributed storage system; andcommunicating performance metrics of the plurality of log streams; a transaction component configured for:
receiving a request to perform a transaction using a log stream of the distributed storage system, wherein the request is received from a partition of the distributed storage system;determining whether to identify a log stream using one or more of: a performance capacity scheme and a request attribute scheme;identifying the log stream using the performance capacity scheme, wherein identifying the log stream using the performance capacity scheme comprises:
accessing the performance metrics of the plurality of log streams, wherein the performance metrics indicate a performance capacity, of a selected log stream, to process the request; andselecting the log stream based on the performance capacity;identifying the log stream using the request attribute scheme, wherein identifying the log stream using the request attribute scheme comprises:
accessing the requesting attributes of the request, wherein the request attributes indicate a performance isolation trait for processing the request; andselecting the log stream based on the performance isolation trait;communicating the request to be executed using the log stream identified based on the performance capacity; andcommunicating the request to be executed using the log stream identified based on the performance isolation trait.