LIMITING DATA OUTPUT FROM WINDOWING OPERATIONS

摘要

A method for regulating output from stream operators performing a windowing operation may include receiving stream of tuples to be processed by a plurality of processing elements, each processing element having one or more stream operators. The method may also include receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions. The method may then include processing the stream of accumulated tuples in response to a window trigger, where the processing generates a quantity of output. At least one processor may then monitor the quantity of output to determine whether the quantity of output exceeds a data output threshold. The processing may then be adjusted, in response to determining that the quantity of output exceeds the data output threshold, to reduce the output to approach the data output threshold.

主权项

1. A computer implemented method for regulating output from one or more stream operators performing a windowing operation, comprising:
receiving stream of tuples to be processed by a plurality of processing elements operating on one or more processors, each processing element having one or more stream operators; receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions; processing, by the first stream operator, the stream of accumulated tuples in response to a window trigger,
wherein the processing generates a quantity of output; monitoring, by at least one processor, the quantity of output; determining whether the quantity of output exceeds a data output threshold; and adjusting, in response to determining that the quantity of output exceeds the data output threshold, the processing to reduce the output to approach the data output threshold.