Using predictive determinism within a streaming environment

摘要

Techniques are described for transmitting predicted output data on a processing element in a stream computing application instead of processing currently received input data. The stream computing application monitors the output of a processing element and determines whether its output is predictable, for example, if the previously transmitted output values are within a predefined range or if one or more input values correlate with the same one or more output values. The application may then generate a predicted output value to transmit from the processing element instead of transmitting a processed output value based on current input values. The predicted output value may be, for example, an average of the previously transmitted output values or a previously transmitted output value that was transmitted in response to a previously received input value that is similar to a currently received input value. Moreover, the processing element or elements that transmit the predicted output data may be upstream from the processing element with the predictable output.

主权项

1. A computer program product for processing data, the computer program product comprising:
a computer-readable memory having computer-readable program code embodied therewith, the computer-readable program code configured to:
receive streaming data to be processed by a plurality of processing elements;establish an operator graph of the plurality of processing elements, the operator graph defining at least one execution path and wherein at least one of the processing elements of the operator graph is configured to receive data from at least one upstream processing element and transmit data to at least one downstream processing element;determine that an output of a first processing element of the plurality of processing elements is predictable based on at least one previously transmitted output value;receive a current input value at a second processing element of the plurality of processing elements, wherein the second processing element is unable to meet one or more throughput requirements for the streaming data by processing the received current input value; andin response to receiving the current input value, and instead of processing the received current input value, transmit a predicted output value from the second processing element, wherein the predicted output value is based on previously computed output values generated by the second processing element.