SCHEDULING HOMOGENEOUS AND HETEROGENEOUS WORKLOADS WITH RUNTIME ELASTICITY IN A PARALLEL PROCESSING ENVIRONMENT

摘要

Systems and methods are provided for scheduling homogeneous workloads including batch jobs, and heterogeneous workloads including batch and dedicated jobs, with run-time elasticity wherein resource requirements for a given job can change during run-time execution of the job.

主权项

1. A method for scheduling jobs in a HPC (high-performance computing) system, comprising:
maintaining a batch jobs queue comprising batch jobs, wherein each batch job in the batch jobs queue has a plurality of parameters associated therewith, the parameters comprising a num parameter that denotes a number of processors of the HPC system that are required to execute the batch job, a dur parameter that denotes a user-estimated execution time of the batch job, an arr parameter that denotes an arrival time of the batch job, and an scount parameter that specifies a number of scheduling cycles that the batch job was skipped and not scheduled; initiating a scheduling cycle in response to a triggering event; and performing a scheduling process to schedule one or more batch jobs in the batch jobs queue for execution by the HPC system, wherein performing a scheduling process comprises:
determining a number m of available processors in the HPC system; andscheduling a head batch job in the batch jobs queue for execution in the HPC system if the num parameter of the head batch job is less than or equal to m and if the scount parameter of the head batch job is greater than or equal to an scount threshold value.