VARIABLE TIMESLICES FOR PROCESSING LATENCY-DEPENDENT WORKLOADS

摘要

A virtualization host may implement variable timeslices for processing latency dependent workloads. Multiple virtual compute instances on a virtualization host may utilize virtual central processing units (vCPUs) to obtain physical processing resources, such as one or more central processing units (CPUs). A vCPU currently utilizing a CPU to performing processing work according to a scheduled timeslice may be preempted by a latency dependent vCPU before completion of the scheduled timeslice. The latency-dependent vCPU may complete processing work, and utilization of the CPU may be returned to the vCPU. A preemption compensation may be determined for the scheduled timeslice to increase the scheduled timeslice for the vCPU such that utilization for the vCPU is performed according to the increased scheduled timeslice.

主权项

1. A system, comprising:
at least one processor; a memory, comprising program instructions that when executed by the at least one processor cause the at least one processor to implement a virtualization host for a plurality of virtual compute instances; the virtualization host, configured to:
for a given virtual central processing unit (vCPU) of a virtual compute instance of the plurality of virtual compute instances, wherein the given vCPU currently utilizes the at least one processor according to a scheduled timeslice:
preempt the given vCPU to utilize the processor for a latency-dependent vCPU of a different virtual compute instance of the plurality of virtual compute instances, wherein the preemption pauses the utilization of the at least one processor for the given vCPU prior to completion of the scheduled timeslice for the given vCPU;upon resumption of the utilization of the at least one processor for the given vCPU:
determine a preemption compensation for the scheduled timeslice of the given vCPU; andincrease the scheduled timeslice for the given vCPU such that the utilization of the at least one processor for the given vCPU is performed according to the increased scheduled timeslice.