System and Method for Creating Highly Scalable High Availability Cluster in a Massively Parallel Processing Cluster of Machines in a Network

摘要

System and method embodiments are provided to implement highly scalable and high availability (HA) clusters in massively parallel processing (MPP) systems. The embodiments include a method to build a highly scalable MPP HA cluster, which provides HA to the cluster while allowing it to scale to relatively larger number of nodes. An embodiment apparatus includes a plurality of data processing nodes distributed in a plurality of corresponding sub-clusters and configured to exchange heart-beat messages between each other within limit of each of the corresponding sub-clusters to maintain sub-cluster membership integrity and detect failures in the corresponding sub-clusters. The sub-clusters are arranged in a fan-out tree hierarchy and configured to prevent heart-beat messaging between each other.

主权项

1. A method for providing a massively parallel processing (MPP) cluster of processing nodes, the method comprising:
dividing the MPP cluster into a plurality of sub-clusters; arranging the sub-clusters into a fan-out tree hierarchy; and exchanging heart-beat messages between the processing nodes in each of the sub-clusters to maintain cluster membership integrity of the processing nodes in each of the sub-clusters.