Data Flow Graph Optimization Using Adaptive Rule Chaining

摘要

A query is received and an initial data flow graph comprising a plurality of nodes is generated for executing the query. The initial data flow graph is optimized using a model optimizer that accesses at least one of a plurality of patterns to identify a matching pattern and executes at least one optimization rule associated with a matching pattern. Execution of the query is then initiated using the optimized data flow graph. Related apparatus, systems, techniques and articles are also described.

主权项

1. A method comprising:
receiving a query; generating, by a calculation engine, an initial data flow graph comprising a plurality of nodes for executing the query, the calculation engine operating in a calculation engine layer above a logical layer which, in turn, interacts with a physical table pool; optimizing, by the calculation engine, the initial data flow graph using a model optimizer, the model optimizer accessing at least one of a plurality of patterns to identify a matching pattern and executing at least one optimization rule associated with a matching pattern; and initiating executing of the query by invoking the calculation engine to execute the optimized data flow graph.