SYSTEMS AND METHODS FOR MINIMIZING COMMUNICATIONS

摘要

A system for allocation of one or more data structures used in a program across a number of processing units takes into account a memory access pattern of the data structure, and the amount of total memory available for duplication across the several processing units. Using these parameters duplication factors are determined for the one or more data structures such that the cost of remote communication is minimized when the data structures are duplicated according to the respective duplication factors while allowing parallel execution of the program.

主权项

1. A method for allocating data structures to a plurality of processing nodes, each processing node having a respective local memory, the method comprising performing by a processor the steps of:
(a1) selecting as a first data structure, a data structure having a read-write ratio greater than a read-write threshold; (b1) computing a first duplication factor for the first data structure; and (c1) generating a first statement allocating the first data structure duplicated by the first duplication factor, across the plurality of processing nodes.