METHOD FOR IMPROVING ENERGY EFFICIENCY OF MAP-REDUCE SYSTEM AND APPARATUS THEREOF

摘要

This technique improves energy efficiency of MapReduce system by using system performance model without changing any component of the MapReduce system. This involves determining presence of any hardware bottleneck in any node of MapReduce system based on a system performance model and if any hardware bottleneck is present in any node, then the maximum bandwidth value of hardware associated with the bottleneck of each node is determined. Thereafter, an energy efficient value of Central Processing Unit (CPU) frequency of each node having the bottleneck is determined by using the system performance model and the maximum bandwidth value of hardware associated with the bottleneck. Further, the CPU frequency of each node having the bottleneck is set at the energy efficient value determined in the earlier step.

主权项

1. A computer-implemented method for improving energy efficiency of a computing system running a MapReduce procedure, comprising:
determining, by a computing device, presence of a hardware bottleneck in at least one node of the MapReduce system based on wait time of an application to be executed in the at least one node and the resource utilization value of the at least one node obtained by using a system performance model; obtaining, by a computing device, a maximum bandwidth value of hardware associated with the bottleneck for the at least one node; determining, by a computing device, an energy efficient value of a central processing unit (CPU) frequency for the at least one node to remove the bottleneck by using a data throughput value of the at least one node obtained from the system performance model and the maximum bandwidth value of the hardware of the at least one node associated with the bottleneck; and setting, by a computing device, the CPU frequency of the at least one node at the energy efficient value to perform a task.