SYSTEM AND METHOD FOR LOAD BALANCING IN A DISTRIBUTED SYSTEM BY DYNAMIC MIGRATION

摘要

A system and method for load balancing between components of a distributed data grid. The system and method support dynamic data migration of selected data partitions in response to detection of hot spots in the data grid which degrade system performance. In embodiments, the system and method relies upon analysis of per-partition performance statistics for both the identification of data nodes which would benefit from data migration and the selection of data nodes for migration. Tuning of the data migration thresholds and method provides for optimizing throughput of the data grid to avoid degradation of performance resulting from load-induced hot spots.

主权项

1. A method for load balancing in a cluster storage system comprising a plurality of nodes, the method comprising:
identifying a source node within the cluster storage system from which to move a plurality of data objects, wherein the source node comprises a node with exceptional wait times compared to other nodes, and homogeneous wait times among its partitions; analyzing the partitions on the source node to identify hot partitions wherein a hot partition is a partition with a disproportionately large share of the execution time load compared to other partitions of the source node; and alleviating load on the source node by migrating one or more partitions from the source node to a target node, wherein the one or more partitions are selected from not hot partitions.