PRIORITIZATION OF NETWORK TRAFFIC IN A DISTRIBUTED PROCESSING SYSTEM

摘要

Described herein are techniques enabling the prioritization of network traffic in a distributed processing system. Information may be received regarding a plurality of flows, each flow configured to travel from one node to another node in the distributed processing system. Each flow may comprise a segment of at least one job. A priority associated with each flow may be identified. A flow table modification message for each flow may be generated. The flow table modification message can include a timeout value and a priority value consistent with the priority associated with the flow.

主权项

1. A method to enable prioritization of network traffic in a distributed processing system, comprising, by a processor:
accessing information regarding a plurality of flows, each flow configured to travel from a mapper node to a reducer node in a map-reduce cluster of nodes, each flow comprising a segment of at least one job; identifying a highest job priority associated with each flow based on the received information; and generating a flow table modification message for each flow, the flow table modification message comprising (1) a priority value consistent with the highest job priority associated with the flow and (2) a timeout value.