Resource allocation in job scheduling environment

摘要

According to embodiments of the disclosure, methods, systems, and computer program products are disclosed. A computer implemented method of allocating resources in a job scheduling system may include segmenting a workload plan into one or more time slots, determining, prior to each time slot, a job forecast for the time slot, the job forecast based on historical job data, and modifying the resource pool to bring a resource pool parameter within a resource range in response to determining that the job forecast exceeds a job deadline. The workload plan may have one or more jobs for a resource pool, the one or more jobs may be scheduled in at least one of the time slots. The resource pool may have one or more resources.

主权项

1. A computer implemented method of allocating resources in a job scheduling system, the method comprising:
segmenting a workload plan into one or more time slots, the workload plan having one or more jobs for a resource pool of a resource provider, the one or more jobs scheduled in at least one of the time slots, the resource pool of the resource provider having one or more resources, wherein the workload plan is a schedule for executing jobs using the one or more resources in the resource pool of the resource provider; determining during each time slot, a respective job forecast for a respective next time slot, each respective job forecast including a respective job completion date for one or more jobs scheduled in the respective next time slot and a prediction of resources needed by the resource pool of the resource provider to perform the one or more scheduled jobs within the respective next time slot, wherein the job completion date is based on historical job data and an arrival rate of transactional jobs observed in one or more previous time slots, wherein the transactional jobs are not scheduled in the workload plan; and for each respective next time slot in which the respective job completion date exceeds a job deadline, modifying the resource pool of the resource provider prior to start of the respective next time slot to bring a resource pool parameter within a resource range in response to determining that the respective job completion date for the one or more jobs scheduled in the respective next time slot exceeds the job deadline; wherein modifying the resource pool of the resource provider includes allocating additional virtual machines in the resource pool of the resource provider such that the one or more jobs scheduled in the respective next time slot are performed within the respective next time slot.