MANAGING OPERATIONAL THROUGHPUT FOR SHARED RESOURCES

摘要

Usage of shared resources can be managed by enabling users to obtain different types of guarantees at different times for various types and/or levels of resource capacity. A user can select to have an amount or rate of capacity dedicated to that user. A user can also select reserved capacity for at least a portion of the requests, tasks, or program execution for that user, where the user has priority to that capacity but other users can utilize the excess capacity during other periods. Users can alternatively specify to use the excess capacity or other variable, non-guaranteed capacity. The capacity can be for any appropriate functional aspect of a resource, such as computational capacity, throughput, latency, bandwidth, and storage. Users can submit bids for various types and combinations of excess capacity, and winning bids can receive dedicated use of the excess capacity for at least a period of time.

主权项

1. A computer-implemented method of managing shared resources, comprising:
under control of one or more computer systems configured with executable instructions,
receiving an instance request associated with a user, the instance request specifying a type of resource capacity and a rate of input/output operations to be used in providing an instance for the user, the instance being operable to handle I/O operations on behalf of the user;if the type of capacity is a dedicated capacity type and dedicated capacity for the user with at least the rate of I/O operations is available, generating an instance for the user using the dedicated capacity;if the type of capacity is a reserved capacity type and reserved capacity for the user with at least the rate of I/O operations is available, generating an instance for the user using the reserved capacity;if the type of capacity is an excess capacity type:
determining whether a bid price is a winning bid price, the winning bid price being greater than other pending bids for the same excess capacity and being at least equal to a current market price;if the bid price is the winning bid price and excess capacity for the user with at least the rate of I/O operations is available, generating an instance for the user using the excess capacity for at least a minimum period of time; andif the type of capacity is a variable capacity type and variable capacity is available, generating an instance for the user using the variable capacity, the variable capacity capable of having less than the rate of I/O operations specified for the instance request.