ON DEMAND PARALLELISM FOR COLUMNSTORE INDEX BUILD

摘要

The degree of parallel processing used to build a database index can be dynamically adjusted based on actual memory usage of individual parallel processing units. Memory can be reserved to prevent an out-of-memory condition. A predetermined number of initial parallel processing units can be activated. The actual usage of resources by the initial activated parallel processing unit(s) can be measured to establish an initial baseline for resource consumption per parallel processing unit. The baseline for resource consumption per parallel processing unit can be used to determine how many additional parallel processing units are activated. The actual resource usage of each parallel processing unit can be measured and used to refine the baseline memory usage. The refined average memory usage can be used to determine how many additional parallel processing units are activated.

主权项

1. A system comprising:
at least one processor: a memory connected to the at least one processor: and a module that when loaded into the memory causes the at least one processor to:
adjust a degree of parallel processing employed in executing an application while the application is miming by:reserving resources for parallel processing;activating an initial number of parallel processing units based on an initial baseline resource utilization;measuring actual resources used by each of the activated parallel processing units;updating the initial baseline resource utilization using a computation derived from the actual resources used, generating a current baseline resource utilization; anddetermine a number of additional parallel processing units to activate based on the current baseline resource utilization.