Scheduling jobs in a cluster by constructing multiple subclusters based on entry and exit rules

摘要

Jobs are scheduled in a cluster comprising multiple computing nodes. The scheduling of jobs includes defining rules for constructing virtual sub-clusters of the multiple computing nodes. The multiple nodes in the cluster can be placed into multiple virtual sub-clusters based on the rules, wherein one computing node can only be included in one virtual sub-cluster. A job is received and dispatched to a selected virtual sub-cluster. At least one computer node is scheduled for the dispatched job in the selected virtual sub-cluster. Further, the job is dispatched to the selected virtual sub-cluster based on characteristics of the job and/or characteristics of virtual sub-clusters.

主权项

1. A method for scheduling a job in a cluster including multiple computing nodes, comprising:
constructing the multiple computing nodes in the cluster into multiple virtual sub-clusters based on rules defining construction of virtual sub-clusters of the multiple computing nodes, the rules including entry rules and exit rules for the multiple virtual sub-clusters, the rules configurable to specify a plurality of characteristics for including a computing node of the multiple computing nodes into a virtual sub-cluster, wherein the plurality of characteristics include at least one member of a group consisting of a number of processors, a memory allocation, and a priority; dispatching a received job to a selected virtual sub-cluster; scheduling at least one computing node for the received job in the selected virtual sub-cluster; and in response to a state change of a computing node, reorganizing the virtual sub-cluster to which the computing node belongs, the reorganizing including: determining whether the computing node satisfies an exit rule of the virtual sub-cluster, and excluding the computing node from the virtual sub-cluster in response to determining that the computing node satisfies the exit rule.