MANAGEMENT OF PERIODIC REQUESTS FOR COMPUTE CAPACITY

摘要

A system for monitoring incoming code execution requests and scheduling the corresponding code executions is provided. The system may be configured to maintain a plurality of virtual machine instances. The system may be further configured to determine whether at least some of the incoming code execution requests exhibit periodicity, and cause a reduced amount of idle compute capacity to be maintained on the virtual compute system. The system may be further configured to cause additional compute capacity to be added shortly before code execution requests are expected to be received.

主权项

1. A system for providing low-latency computational capacity from a virtual compute fleet, the system comprising:
an electronic data store configured to store at least a program code of a user; and a virtual compute system comprising one or more hardware computing devices executing specific computer-executable instructions, said virtual compute system in communication with the data store, and configured to at least:
maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprise:
a warming pool comprising virtual machine instances having one or more software components loaded thereon and waiting to be assigned to a user; andan active pool comprising virtual machine instances currently assigned to one or more users;monitor incoming code execution requests to execute program codes on the virtual compute system, at least some of the incoming code execution requests exhibiting a degree of periodicity;determine the degree of periodicity associated with the at least some of the incoming code execution requests, the determined degree of periodicity indicating a time period at which the at least some of the incoming code execution requests are expected to be received by the virtual compute system;in response to determining the degree of periodicity associated with the at least some of the incoming code execution requests, cause a reduced number of virtual machine instances to be maintained in the warming pool, wherein the reduced number is determined based on a number of the at least some of the incoming code execution requests and the determined degree of periodicity;cause at least one virtual machine instance to be added to the active pool before the time period, and cause a program code associated with the at least some of the incoming code execution requests to be loaded on the at least one virtual machine instance; andin response to receiving a request associated with the at least some of the incoming code execution requests, cause the program code loaded on the at least one virtual machine to be executed.