METHOD AND APPARATUS FOR RIPPLE RATE SENSITIVE AND BOTTLENECK AWARE RESOURCE ADAPTATION FOR REAL-TIME STREAMING WORKFLOWS

摘要

A method, non-transitory computer readable medium, and apparatus for adapting resources of the cluster of nodes for a real-time streaming workflow are disclosed. For example, the method receives a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck, identifies a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement, transmits the resource statement to at least one or more nodes of the cluster of nodes within the number of hops, receives a response from one of the at least one or more nodes within the cluster of nodes and adapts a resource usage to the at least one of the one or more nodes within the cluster of nodes that the response was received from.

主权项

1. A method for adapting resources of the cluster of nodes for a real-time streaming workflow, comprising:
receiving, by a processor, a notification that a node of the cluster of nodes associated with an instance of a process of the real-time streaming workflow is predicted to be a bottleneck; identifying, by the processor, a number of hops to send a resource statement when the bottleneck is predicted that minimizes a ripple effect associated with transmitting the resource statement; transmitting, by the processor, the resource statement to one or more nodes of the cluster of nodes within the number of hops; receiving, by the processor, a response from at least one of the one or more nodes within the cluster of nodes; and adapting, by the processor, a resource usage to the at least one of the one or more nodes within the cluster of nodes that the response was received from.