METHOD AND SYSTEM FOR EFFICIENT EXECUTION OF ORDERED AND UNORDERED TASKS IN MULTI-THREADED AND NETWORKED COMPUTING

摘要

The present disclosure provides methods for concurrently executing ordered and unordered tasks using a plurality of processing units. Certain embodiments of the present disclosure may store the ordered and unordered tasks in the same processing queue. Further, processing tasks in the processing queue may comprise concurrently preprocessing ordered tasks, thereby reducing the amount of processing unit idle time and improving load balancing across processing units. Embodiments of the present disclosure may also dynamically manage the number of processing units based on a rate of unordered tasks being received in the processing queue, a processing rate of unordered tasks, a rate of ordered tasks being received in the processing queue, a processing rate of ordered tasks, and/or the number of sets of related ordered tasks in the processing queue. Also provided are related systems and non-transitory computer-readable media.

主权项

1. A method for concurrently executing ordered and unordered tasks using a plurality of processing units, the method comprising:
receiving an unordered task or an ordered task into a processing queue; processing a task in the processing queue using at least one processing unit,
wherein if the task is an unordered task or an ordered task with no other processing unit processing a related ordered task, the processing unit processes the task,wherein if the task is an ordered task and another processing unit is processing a related ordered task, the processing unit preprocesses the ordered task if the ordered task needs preprocessing; and dynamically managing the number of processing units.