USE OF METRICS TO CONTROL THROTTLING AND SWAPPING IN A MESSAGE PROCESSING SYSTEM

摘要

A system and method of using metrics to control throttling and swapping in a message processing system is provided. A workload status of a message processing system is determined, and the system polls for a new message according to the workload status. The message processing system identifies a blocked instance and calculates an expected idle time for the blocked instance. The system dehydrates the blocked instance if the expected idle time exceeds a predetermined threshold.

主权项

1. A system comprising a processor and a memory communicatively coupled to the processor, the memory comprising instructions that, when executed by the processor, cause the system to:
determine a workload of the system based on performance metrics of the system; receive a message system and, in response to receiving the message, create an instance of a process or route the message to an existing instance of a process; idle the created instance or the existing instance based on the determined workload of the system; determine a predicted duration for the idling based on the performance metrics; based on the predicted duration, move the idled instance out of active memory and into secondary storage associated with the system; and update the determined workload based on updated performance metrics and said moving the idled instance out of active memory.