METHOD AND SYSTEM FOR ACHIEVING ANALYTIC FUNCTION BASED ON MAPREDUCE

摘要

Provided are a method and system for achieving an analytic function based on MapReduce. The method comprises: a table scan operator acquiring a data line from a file block, and sending the data line to a mapping operator; the mapping operator receiving the data line, determining a reduction key, a partition key and a sort key of an analytic function, and sending the data line to an analytic operator through a MapReduce framework; and the analytic operator receiving the data line, analyzing the data line to obtain an analytic result, and forwarding the data line and the analytic result to a subsequent operator. The present disclosure can achieve an analytic function in a distributed data warehouse of the MapReduce framework, thereby solving the problem that data analysis processing cannot be performed using the analytic function in the distributed data warehouse based on the MapReduce framework.