Systems and methods for tracking working-set estimates with a limited resource budget

摘要

Embodiments of the systems and techniques described here can leverage several insights into the nature of workload access patterns and the working-set behavior to reduce the memory overheads. As a result, various embodiments make it feasible to maintain running estimates of a workload's cacheability in current storage systems with limited resources. For example, some embodiments provide for a method comprising estimating cacheability of a workload based on a first working-set size estimate generated from the workload over a first monitoring interval. Then, based on the cacheability of the workload, a workload cache size can be determined. A cache then can be dynamically allocated (e.g., change, possibly frequently, the cache allocation for the workload when the current allocation and the desired workload cache size differ), within a storage system for example, in accordance with the workload cache size.

主权项

1. A method for caching allocation performed on a storage system, the method comprising:
estimating cacheability of a workload from a first working-set size estimate generated from the workload over a first monitoring interval; determining if the first working-set size estimate should be stored by monitoring a value change in a working-set size over multiple monitoring intervals, determining from a previous iteration if a similar working-set size estimate was stored, or updating the first working-set size estimate based on a second working-set size estimate from a similar workload; determining, using a processor, a workload cache size based on the cacheability of the workload; and dynamically allocating a cache within the storage system in accordance with the workload cache size.