Data Management for Multiple Processing Units Using Data Transfer Costs

摘要

Various embodiments include methods for data management in a computing device utilizing a plurality of processing units. Embodiment methods may include generating a data transfer heuristic model based on measurements from a plurality of sample data transfers between a plurality of data storage units. The generated data transfer heuristic model may be used to calculate data transfer costs for each of a plurality of tasks. The calculated data transfer costs may be used to schedule execution of the plurality of tasks in an execution order on selected ones of the plurality of processing units. The data transfer heuristic model may be updated based on measurements of data transfers occurring during the executions of the plurality of tasks (e.g., time, power consumption, etc.). Code executing on the processing units may indicate to a runtime when certain data blocks are no longer needed and thus may be evicted and/or pre-fetched for others.

主权项

1. A method for data management in a computing device utilizing a plurality of processing units, comprising:
generating a data transfer heuristic model based on measurements from a plurality of sample data transfers between a plurality of data storage units; calculating data transfer costs for each of a plurality of tasks using the generated data transfer heuristic model; configuring the plurality of tasks to be performed on the plurality of processing units based at least on the calculated data transfer cost by prioritizing the plurality of tasks to obtain a scheduling priority order; executing a first task in the scheduling priority order on a first processing unit; determining whether a first data block within a first data storage unit associated with the first processing unit is no longer needed during execution of the first task; and evicting the first data block from the first data storage unit in response to determining that the first data block is no longer needed during the execution of the first task.