Dynamically adapting the configuration of a multi-queue cache based on access patterns

摘要

A multi-queue cache is configured with an initial configuration, where the initial configuration includes one or more queues for storing data items. Each of the one or more queues has an initial size. Thereafter, the multi-queue cache is operated according to a multi-queue cache replacement algorithm. During operation, access patterns for the multi-queue cache are analyzed. Based on the access patterns, an updated configuration for the multi-queue cache is determined. Thereafter, the configuration of the multi-queue cache is modified during operation. The modifying includes adjusting the size of at least one of the one or more queues according to the determined updated configuration for the multi-queue cache.

主权项

1. A computer-implemented method for dynamically adjusting a configuration of a multi-queue cache comprising:
configuring the multi-queue cache with an initial configuration, wherein the initial configuration includes one or more queues for storing data items, each of the one or more queues having an initial size; operating the multi-queue cache according to a multi-queue cache replacement algorithm; analyzing access patterns for the multi-queue cache during operation of the multi-queue cache; determining, based on the access patterns, that the size of a particular queue in the one or more queues is to be adjusted, wherein the size of the particular queue represents physical storage capacity of the particular queue and is independent from amount of data stored in the particular queue; and in response to the determining:
generating, based on the access patterns, an updated configuration for the multi-queue cache including a new size for the particular queue, including
determining the new size for the particular queue in accordance with a cache hit ratio associated with the one or more queues; anddynamically modifying the configuration of the multi-queue cache during operation of the multi-queue cache, wherein the modifying includes adjusting the size of the particular queue to the new size according to the updated configuration for the multi-queue cache.