摘要 |
In a distributed processing device, there are provided: a collective communication means in which at least one activated process executes a local collective communication among a plurality of processes within one process group among a plurality of process groups generated by partitioning the plurality of processes by a first partitioning pattern; and a communication control means for selecting, after the local collective communication, a second partitioning pattern different from the first partitioning pattern used in the local collective communication and allowing the collective communication means to execute a next local collective communication using data based on a result of the local collective communication among a plurality of processes within one process group among a plurality of process groups generated by partitioning the plurality of processes by the second partitioning pattern. |