Dynamic throttling systems and services

摘要

A lightweight throttling mechanism allows for dynamic control of access to resources in a distributed environment. Each request received by a server of a server group is parsed to determine tokens in the request, which are compared with designated rules to determine whether to process or reject the request based on usage data associated with an aspect of the request, the token values, and the rule(s) specified for the request. The receiving of each request can be broadcast to throttling components for each server such that the global state of the system is known to each server. The system then can monitor usage and dynamically throttle requests based on real time data in a distributed environment.

主权项

1. A computer-implemented method for determining access to a resource in an electronic environment, comprising:
under the control of one or more computer systems configured with executable instructions,
receiving a client request for access to a resource;parsing the client request to determine a token associated with the request, the token being associated with at least a parameter of the request;tracking a frequency of requests associated with the token over time; anddetermining whether to add a client associated with the token to a collection as a candidate for throttling based at least in part on the frequency of requests associated with the token, wherein determining whether to add the client to the collection as a candidate for throttling further comprises:
providing local request data to one or more throttling components distributed across a server group;receiving one or more instances of network request data from the one or more throttling components distributed across the server group; andgenerating global request data from the local request data and the one or more instances of network request data.