Method and system for guiding scheduling decisions in clusters of computers using dynamic job profiling

摘要

A method and system for scheduling jobs in a cluster of compute servers using dynamic job profiling improves the overall performance of the computing cluster. Specifically, the method and system monitors the performance of individual compute servers in a cluster, and assigns jobs to particular compute servers based on the most current performance information of the compute servers. As the job profiles of the compute servers change with every job processed, the decision as to which compute server is most appropriate for a particular job will dynamically change. Various scheduling algorithms can be used in connection with the method and system to assign jobs to specific compute servers based on the available information in the job profiles.