Resource aware scheduling in a distributed computing environment

摘要

Systems and methods for resource aware scheduling of processes in a distributed computing environment are described herein. One aspect provides for accessing at least one job and at least one resource on a distributed parallel computing system; generating a current reward value based on the at least one job and a current value associated with the at least one resource; generating a prospective reward value based on the at least one job and a prospective value associated with the at least one resource at a predetermined time; and scheduling the at least one job based on a comparison of the current reward value and the prospective reward value. Other embodiments and aspects are also described herein.

主权项

1. A computer program product comprising:
a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code comprising: computer-readable program code configured to access at least one multi-stage job and at least one resource on a distributed parallel computing system; computer-readable program code configured to generate a current reward value based on the at least one job and a current value associated with the at least one resource; computer-readable program code configured to launch a first stage of at least one job, based on the current reward value; computer-readable program code configured to generate a prospective reward value based on the at least one job and a prospective value associated with the at least one resource at a predetermined time; and computer-readable program code configured to schedule a second stage of at least one job based on a comparison of the current reward value and the prospective reward value.