Enhancing Analytics Performance Using Distributed Multi-Tiering

摘要

Embodiments relate to cluster-centric tiered storage with a flexible tier definition to support performance of transactions. Object data is distributed in a multi-tiered shared-nothing cluster. Hierarchical tiers of data storage are assigned different roles within the hierarchy. The tiers are arranged according to a number of cycles required to access a tier. The tiers are managed globally across the cluster and objects are placed in tiers according to a flexible tier definition and the tier arrangement. The probability of object access is computed for objects, and objects are placed on different tiers responsive to the computation and the number of cycles required to access the tier. Objects are moved between tiers responsive to a probability frequency of object access.

主权项

1. A method comprising:
in a computer cluster in communication with a storage system, the storage system organized in a hierarchy, assigning a different role to each storage tier within the hierarchy, each role related to a workload characteristic; arranging the tiers according to a number of cycles required to access a tier; managing the tiers across the cluster, the management responsive to a flexible tier definition within the hierarchy and the tier arrangement; and selecting a first storage tier for placement of a data object, and placing the data object in the first tier, the selection responsive to a calculated probability of access of the object and the number of cycles required to access the tier.