Management of stream operators with dynamic connections

摘要

One embodiment is directed to a method for processing a stream of tuples in a stream-based application. A stream operator may receive a stream of tuples. A stream manager may determine whether a dynamic connection exists at a first stream operator. The dynamic connection may connect the first stream operator to a second stream operator. The stream manager may poll the first stream operator and the second stream operator for a presence of the dynamic connection. The stream manager may modify processing of one or more upstream stream operators in response to a change in use of the dynamic connection.

主权项

1. A method for processing a stream of tuples, comprising:
receiving a stream of tuples to be processed by a plurality of processing elements operating on one or more computer processors, each processing element having one or more stream operators; determining whether a dynamic connection exists at a first stream operator, wherein the dynamic connection connects the first stream operator to a second stream operator, wherein the dynamic connection allows introduction of one or more additional stream operators without modifying an operator graph of the one or more stream operators, wherein the first stream operator is from a first application instance and the second stream operator is from a second application instance; determining, in response to determining an absence of the dynamic connection between the first stream operator and the second stream operator, whether an upstream stream operator from the dynamic connection transmits to another active stream operator; and deactivating the upstream stream operator in response to the absence of the dynamic connection, wherein the deactivating the upstream stream operator occurs by deactivating an input port of the stream operator.