System for multi-store analytics execution environments with storage constraints

摘要

Systems and methods are disclosed for managing a multi-store execution environment by applying opportunistic materialized views to improve workload performance and executing a plan on multiple database engines to increase query processing speed by leveraging unique capabilities of each engine by enabling stages of a query to execute on multiple engines, and by moving materialized views across engines.

主权项

1. A method for managing an execution environment, comprising:
applying opportunistic materialized views; executing a plan on multiple database engines to increase query processing speed by enabling stages of a query to execute on multiple engines, and by moving materialized views across engines; determining a multi-store execution plan P, as:
P=(G,ƒ,t)where G represents a directed acyclic graph (DAG) for a plan, and is ordered topologically with a vertex in G corresponding to a stage s in plan P, ƒ:PE is a mapping function that maps a stage in P to an execution engine in E, t:VE is a transfer function that indicates transfer of views in V to an engine in E, and a stage sεP may be executed on any engine; and
determining a multi-store configuration created after executing all plans prior to Pi by:inputDesign⁡(Pi,D)={D,i=1outputDesign⁡(Pi-1,inputDesign⁡(Pi-1,⁢D)),otherwisewhere outputDesign(P,D)=outputDesign(s′,D), where s′ is the last stage of P.