发明名称 DATA PROCESSING DEVICE AND METHOD FOR PROCESSING SERIAL TASKS
摘要 Embodiments of the present invention disclose a data processing apparatus and method for processing serial tasks, which can reduce, in a data processing process, a quantity of times of reading an output result from disks of node devices in a distributed system, thereby reducing time required and network resources occupied for processing a large amount of data. The method in the present invention includes: acquiring at least two MapReduce tasks, where the at least two MapReduce tasks are serially arranged according to an execution sequence, and when two MapReduce tasks are serially arranged, an output value obtained after the former MapReduce task is executed is an input value of the latter MapReduce task; combining the at least two MapReduce tasks to obtain a target MapReduce task; and executing the target MapReduce task, and obtaining an output result of the target MapReduce task.
申请公布号 EP3113020(A1) 申请公布日期 2017.01.04
申请号 EP20140883718 申请日期 2014.11.05
申请人 Huawei Technologies Co., Ltd. 发明人 LIU, Yanchu;LIU, Chao
分类号 G06F9/46 主分类号 G06F9/46
代理机构 代理人
主权项
地址