Dynamic Resource-based Parallelization in Distributed Query Execution Frameworks

摘要

As part of query processing within a distributed execution environment framework, available resources taken into account when generating an execution plan and/or executing an execution plan to determine whether to parallelize any operations. Related apparatus, systems, methods and articles are also described.

主权项

1. A method comprising:
receiving, by a database server from a remote application server, a query associated with a calculation scenario that defines a data flow model that includes one or more calculation nodes that each define one or more operations to execute by a calculation engine on the database server, at least one of the nodes comprising a dynamic split operator; instantiating, by the database server, a runtime model of the calculation scenario based on the nodes of the instantiated calculation scenario; building an execution plan of the runtime model of the calculation scenario based on operations defined by the calculation nodes of the instantiated scenario and based on fetched data characterizing available database resources, the available database resources being used to determine whether to split one or more operations specified by the dynamic split operator into two or more parallel processor threads; executing, by the database server, the operations defined by the execution plan to result in a data set; and providing, by the database server to the application server, the data set.