Method and system of network transfer adaptive optimization in large-scale parallel computing system

摘要

A method and system for performing network transfer adaptive optimization in a large-scale parallel computing system. The method of network transfer adaptive optimization includes forming a message to be transferred through the network based on obtained information related to a task executed by computing nodes, wherein the message includes identification information of the computing nodes to perform data transfer and corresponding sink nodes, and an amount of data the computing nodes to transfer to the corresponding sink nodes; transferring the message to a network layer; and forming a new data transfer pattern for data transfer between the computing nodes and the corresponding sink nodes in accordance with the received message.

主权项

1. A method of network transfer adaptive optimization in a large-scale parallel computing system, comprising:
forming a message to be transferred through the network based on obtained information related to a task executed by computing nodes, wherein the message includes identification information of the computing nodes to perform data transfer and corresponding sink nodes, and an amount of data said computing nodes to transfer to said corresponding sink nodes; transferring said message to a network layer; and forming a new data transfer pattern for data transfer between said computing nodes and said corresponding sink nodes in accordance with a received message, wherein said forming a message to be transferred through the network includes formatting the obtained information to form a message in a predetermined format, and wherein said predetermined format is: {one or more }, wherein the total number of triplets indicates the number of triplets in the message.