发明名称 DATA SORTING METHOD AND SYSTEM BASED ON MAPREDUCE MODEL
摘要 <p>A data sorting method and system based on a MapReduce model. The sorting method comprising the following steps: when each MAP module sorts elements in a data block in a MAP phase, each time a sorting result of one element is determined, adding the element to a first-in-first-out data structure; in a Reduce phase, a Reduce module acquiring all current elements in the first-in-first-out data structure; acquiring a current global extremum element; outputting the current global extremum element as a sorting result; removing the output current global extremum element from a Reduce-phase element set, and updating the Reduce-phase element set. With the method and the system, without the need of waiting until a sorting process in a MAP phase ends, an extremum element can be selected from current elements in a first-in-first-out cache queue in a Reduce phase, and a sorting result is output in a streamed manner. In this way, the sorting result can be output in advance, so as to reduce the waiting time of the user.</p>
申请公布号 WO2015014191(A1) 申请公布日期 2015.02.05
申请号 WO2014CN81379 申请日期 2014.07.01
申请人 HUAWEI TECHNOLOGIES CO., LTD. 发明人 ZHU, YUQING;CHEN, XINGZHEN;WANG, LEI;ZHAN, JIANFENG
分类号 G06F17/30 主分类号 G06F17/30
代理机构 代理人
主权项
地址