Implementation of stream algebra over class instances

摘要

Creating and executing a distributed stream processing operator graph based on a query. The operator graph includes movable stream algebra operators for processing events received from high volume data streams. The operators are partially compiled and distributed to computing devices for completion of the compilation and subsequent execution. During execution, the operators maintain minimal state information associated with received events via an expiration time assigned to each of the event instances. Additional events are generated and aggregated by the operators for communication to a service responsible for the query.

主权项

1. A machine for use with a plurality of destination machines for processing high-volume continuous streams of data while maintaining minimal state information associated with the data, said machine comprising:
a subscriber processor linked to the destination machines and configured to execute computer executable instructions for: defining an object to include an expression, said expression representing a function to be performed on events from an event stream;
generating an abstract syntax tree corresponding to the object;serializing the generated abstract syntax tree into a message; and sending the message representing the object to one of the plurality of destination machines, said sent message configured for use by the one destination machine for compiling the expression from the abstract syntax tree into executable code which is executable by the one destination machine on events received from the event stream.