Weighted service requests throttling

摘要

Computing platforms may enable clients to use services to execute data processing tasks. Each of these services consumes resources during execution. Described herein are systems, devices and methods for generating resource consumption data for service calls. The resource consumption data may indicate amounts of resources consumed to process computational tasks associated with service calls. The system may determine when to process computational tasks based on the resource consumption data.

主权项

1. A system comprising:
a service fleet comprising a plurality of host computing devices, the plurality of host computing devices including: a memory storing computer-executable instructions; and a processor, coupled to the memory, to execute the computer-executable instructions to provide a load balancer, a sampler host, and a service host, wherein:
the load balancer is configured to:
receive service calls including a first service call comprising a first request for a first performance of a first computational task, a second service call comprising a second request for a second performance of a second computational task, and a third service call comprising a third request for a third performance of a third computational task;provide the first service call and the second service call to the sampler host; andprovide the third service call to the service host;the sampler host is configured to:
process a single service call at a time to individually determine resource consumed by each of the service calls;for the first service call, generate first resource consumption data indicating a first amount of resources consumed to perform the first computational task;for the second service call, generate second resource consumption data indicating a second amount of resources consumed to perform the second computational task;access configurable formula data indicative of a first weight factor associated with the first resource consumption data and indicative of a second weight factor associated with the second resource consumption data;generate a first weighted value by multiplying the first weight factor by the first resource consumption data;generate a second weighted value by multiplying the second weight factor by the second resource consumption data;generate weight data comprising a value generated by combining the first weighted value and the second weighted value; andprovide the weight data to the service host in response to a determination that a threshold amount of resource consumption data has been generated;the service host is configured to process the third service call based on the weight data.