SYSTEM AND METHOD FOR IMPLEMENTING ONLINE ANALYTICAL PROCESSING (OLAP) SOLUTION USING MAPREDUCE

摘要

The technique relates to a system and method for implementing petabyte scale online analytical processing solutions using MapReduce. The technique involves receiving an OLAP query from a user through an OLAP-QL Driver. After receiving the query it is parsed through the compiler. Then the metadata information is retrieved from the parsed query through the metadata manager. Validating the parsed query using plan generator module for generating a MapReduce job execution plan based on the retrieved metadata information. The next step is to identify the scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope. Then executing the optimized MapReduce job plan using the execution engine and finally storing the output data in the cube specific distributed file system directory.

主权项

1. A method for implementing an Online Analytical Processing (OLAP) solution using Map Reduce, the method comprising:
parsing, by the OLAP processing computing system, a received OLAP query; retrieving, by the OLAP processing computing system, metadata information from the parsed OLAP query; validating, by the OLAP processing computing system, the parsed OLAP query and generating a MapReduce job execution plan based on the retrieved metadata information; identifying, by the OLAP processing computing system, a scope for optimization in the generated MapReduce job execution plan and optimizing the MapReduce job execution plan using the identified scope; executing, by the OLAP processing computing system, the optimized MapReduce job execution plan; and storing, by the OLAP processing computing system, data output as a result of the execution in a cube specific distributed file system (DFS) directory.