Scheduling in job execution

摘要

The present invention relates to a method, apparatus, and computer program product for scheduling in job execution. According to embodiments of the present invention, there is provided a method for scheduling a plurality of job slots shared by one or more pre-processors and one or more post-processors in job execution, wherein the data generated by the pre-processor(s) will be fed to the post-processor(s) for processing. The method comprises: determining an overall data generation speed of the pre-processor(s); determining an overall data consumption speed of the post-processor(s); and scheduling allocation of at least one of the job slots between the pre-processor(s) and the post-processor(s) based on the overall data generation speed and the overall data consumption speed. Corresponding apparatus is disclosed as well.

主权项

1. A method for scheduling in job execution, the method comprising: determining, by one or more computer processors, a data feed speed of a first post-processor, wherein the data feed speed of the first post-processor is a speed of feeding data from a plurality of pre-processors to the first post-processor; determining, by one or more computer processors, a data feed speed of a second post-processor, wherein the data feed speed of the second post-processor is a speed of feeding data from the plurality of pre-processors to the second post-processor; determining, by one or more computer processors, a local data feed speed of the first post-processor, wherein the local feed speed of the first post-processor is a speed of feeding data, to the first post-processor, from one or more pre-processors of the plurality of pre-processors that are co-located with the first postprocessor on a physical node of the first post-processor; determining, by one or more computer processors, a local data feed speed of the second post-processor, wherein the local feed speed of the second post-processor is a speed of feeding data, to the second-processor, from one or more pre-processors of the plurality of pre-processors that are co-located with the second post-processor on a physical node of the second post-processor; determining, by one or more computer processors, a locality level of the first post-processor based, at least in part, on the data feed speed of the first post-processor and the local data feed speed of the first post-processor; determining, by one or more computer processors, a locality level of the second post-processor based, at least in part, on the data feed speed of the second post-processor and the local data feed speed of the second postprocessor; determining, by one or more computer processors, a weighting standard of the first post-processor based, at least in part, on the data feed speed of the first-post processor and the locality level of the first post-processor; determining, by one or more computer processors, a weighting standard of the second post-processor based, at least in part, one the data feed speed of the second post-processor and the locality level of the second post processor; and determining, by one or more computer processors, that the weighting standard of the first post-processor is greater than the weighting standard of the second post-processor, and in response, allocating a job slot to the first post-processor.