SMART TUPLE RESOURCE ESTIMATION

摘要

A stream application receives a stream of tuples to be processed by a plurality of processing elements. The plurality of processing elements operate on one or more compute nodes. Each processing element has one or more stream operators. Segments of software code are embedded in a tuple of the stream of tuples. The tuple retrieves one or more compute node metrics. The compute node metrics describe one or more resources of a first compute node. The tuple obtains tuple information of one or more tuples of the stream of tuples to be processed by a first stream operator that operates on the one or more resources. The tuple determines a prospective resource disparity related to the first stream operator based on the obtained tuple information and the compute node metrics. The tuple transmits a resource request to the stream application based on the determined prospective resource disparity.

主权项

1. A method for processing a stream of tuples, the method comprising:
receiving, by a stream application, a stream of tuples to be processed by a plurality of processing elements operating on one or more compute nodes, each processing element having one or more stream operators; assigning, by the stream application, one or more processing cycles to one or more segments of software code embedded in a tuple of the stream of tuples; and executing, by the software-embedded tuple, the following operations:
retrieving one or more compute node metrics that describe one or more resources of a first compute node;obtaining tuple information of one or more tuples of the stream of tuples to be processed by a first stream operator, the first stream operator operating on the one or more resources;determining, based on the obtained tuple information and based on the compute node metrics, a prospective resource disparity related to the first stream operator; andtransmitting, to the stream application and based on the determined prospective resource disparity, a resource request related to the one or more resources.