Workload-aware I/O scheduler in software-defined hybrid storage system

摘要

A workload-aware I/O scheduler in a Software-Defined Hybrid Storage (SDHS) system is disclosed. The scheduler includes a queue managing module, a workload property database, a traffic monitoring module, and a traffic modeling module. The queue managing module further has a request receiving sub-module, a request controlling sub-module, and a request dispatching sub-module. With the operations of the queue managing module, requests for accesses of HDDs and SSDs can be separately queued. Thus, performance of the SDHS can be improved. Meanwhile, the scheduler can be used for requests from a number of workloads at the same time while meet performance requirement of each workload.

主权项

1. A Software-Defined Hybrid Storage (SDHS) system which has at least one Hard Disk Drive (HDD) and a Solid State Drive (SSD), wherein the SDHS system has a workload-aware I/O scheduler for handling a plurality of workloads related to services or infrastructures utilizing the SDHS system, the workload-aware I/O scheduler comprising:
a queue managing module, for managing queues, read requests, and write requests, comprising: a request receiving sub-module, for temporarily holding the read requests and the write requests; a request controlling sub-module, for creating workload queues, the workload queues comprising a read request queue and a write request queue for each of the plurality of workloads, dynamically configuring the workload queues according to a scheduler configuration function, including dynamically adjusting depths of the workload queues, and arranging the read requests and write requests to the workload queues; and a request dispatching sub-module, for creating device queues and dispatching each read request or write request from the workload queues to a specified device queue; a workload property database, for storing properties of the plurality of workloads for access, wherein the properties comprise a read/write ratio, a merge ratio, a SSD hit ratio, and a storage block size; and a traffic monitoring module, for monitoring and continuously recording values of one or more performance parameters of the SDHS system, and providing the values of the one or more performance parameters to the request controlling sub-module; wherein the scheduler configuration function calculates a queue depth and a wait time for each workload queue based on the properties provided from the workload property database and the recorded values of the one or more performance parameters such that the values of the one or more performance parameters of the SDHS system can be adjusted; and wherein each of the one or more performance parameters has a respective performance guarantee and a respective performance throttling and the values of the one or more performance parameters are adjusted while the recorded values are equal to or above the respective performance guarantee and/or the recorded values are equal to or below the respective performance throttling.