Streaming operator with trigger

摘要

One or more operators in a flow graph of a streaming application may include one or more triggers that indicate when action needs to be taken for the operator. A streams manager monitors performance of a streaming application and receives a notification when a trigger in an operator fires. In response to a trigger firing, the streams manager determines an appropriate action corresponding to the trigger. When the trigger indicates an adjustment of cloud resources are needed, the streams manager formulates a cloud resource request to a cloud manager. In response, the cloud manager adjusts the cloud resources for the operator to improve performance of the streaming application. A trigger may specify a trigger action for an operator, and may additionally specify a trigger action for one or more other affected operators. The firing of a trigger in one operator can therefore result in adjusting resources to multiple operators.

主权项

1. An apparatus comprising:
at least one processor; a memory coupled to the at least one processor; a streaming application residing in the memory and executed by the at least one processor, the streaming application comprising a flow graph that includes a plurality of operators that process a plurality of data tuples; a trigger in a first of the plurality of operators that specifies:
trigger criteria that includes data overflow of a memory of the first operator;a corresponding trigger action to perform that comprises logging a snapshot of a virtual machine when the trigger fires due to the data overflow of the memory in the first operator; andan affected operator that is affected by the processing in the first operator by being upstream or downstream from the first operator; and a streams manager residing in the memory and executed by the at least one processor, the streams manager receiving notification when the trigger fires, determining the corresponding trigger action, and initiating at least one operation to perform the corresponding trigger action, wherein the initiation of the at least one operation comprises submitting a first request to a cloud manager to provision additional resources for a first virtual machine running the first operator and submitting a second request to the cloud manager to provision additional resources for a second virtual machine separate from the first virtual machine, wherein the second virtual machine runs the affected operator specified in the trigger.