Performing setup operations for receiving different amounts of data while processors are performing message passing interface tasks

摘要

A system and method are provided for performing setup operations for receiving a different amount of data while processors are performing message passing interface (MPI) tasks. Mechanisms for adjusting the balance of processing workloads of the processors are provided so as to minimize wait periods for waiting for all of the processors to call a synchronization operation. An MPI load balancing controller maintains a history that provides a profile of the tasks with regard to their calls to synchronization operations. From this information, it can be determined which processors should have their processing loads lightened and which processors are able to handle additional processing loads without significantly negatively affecting the overall operation of the parallel execution system. As a result, setup operations may be performed while processors are performing MPI tasks to prepare for receiving different sized portions of data in a subsequent computation cycle based on the history.

主权项

1. A method, in a multiple processor system, for balancing a Message Passing Interface (MPI) workload across a plurality of processors, comprising:
receiving one or more MPI synchronization operation calls from one or more processors of the plurality of processors; identifying a first processor, in the plurality of processors, having a fastest time of completion of a computation phase of an associated MPI task of a MPI job, during a computation cycle, based on the received one or more MPI synchronization operation calls, wherein the computation phase of the first associated MPI task involves executing the MPI task on a first data set; and performing a first setup operation in the first processor for preparing to receive a second data set that is larger than the first data set in response to identifying the first processor as having a fastest time of completion of the computation phase, wherein the first setup operation modifies an allocation of resources in the multiple processor system for use by the first processor in receiving the second data set, wherein the first data set and second data set are associated with the MPI job.