DISTRIBUTED PARALLEL JOB PROCESSING SYSTEM AND METHOD

摘要

A distribution parallel task processing system and a method thereof are provided to efficiently revent intermediate result transmission requests from being concentrated on a specific map task performing device and have log time complexity, thereby improving performance. A plurality of reduce task performing devices(131~133) receives notification of intermediate result path information from a task management device(120). The reduce task performing devices dividedly allocate transmission planned intermediate results to a priority queue per an area according to an identifier order of a map task. The reduce task performing devices select the transmission planned intermediate results of the areas of the priority queue according to priority.