Load balancing when replicating account data

摘要

Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

主权项

1. A computer-implemented method in a distributed computing environment utilizing a processor and memory for identifying when to balance at least one processing load between nodes of the distributed computing environment, the method comprising:
monitoring a workload assigned to a subject partition being hosted on a first node of a storage stamp, wherein the subject partition represents a key range of data for a particular storage account, and wherein the storage stamp represents at least one of a primary storage stamp that includes the nodes configured for hosting a number of source partitions or a secondary storage stamp that includes the nodes configured for hosting a number of destination partitions, and wherein the primary storage stamp and the secondary storage stamp are configured to support replicating the data of the particular storage account between the primary storage stamp and the secondary storage stamp, wherein the primary storage stamp and secondary storage stamp individually maintain replicas of the data for the particular storage account; detecting a level of the subject partition's workload has overcome a predefined threshold; identifying the subject partition as a candidate for receiving a load-balancing operation, wherein the load-balancing operation comprises at least one of splitting, merging, or load balancing the subject partition; and storing in a record, at least temporarily, an indication that the subject candidate is identified as a candidate for receiving a load-balancing operation.