Dynamically configurable placement engine

摘要

A stream application may allocate processing elements to one or more compute nodes (or hosts) to achieve a desired optimization goal. Each optimization mode may define processing element selection criteria and/or host selection criteria. When allocating a processing element to a host, a scheduler may place each processing element individually. Accordingly, the scheduler may use the processing element selection criteria for selecting which processing element in the stream application to allocate next. The scheduler may then determine, based on one or more constraints, which host the processing element can be placed on. If the scheduler determines that multiple hosts are suitable candidates for the processing element, it may use the host selection criteria to pick one of the candidate hosts that further optimize the stream application to meet the desired goal. Examples of different optimization goals that may be achieved using processing element and host selection criteria include optimizing performance, decreasing maintenance and operating costs, increasing solvability, sharing limited computer resources with other applications, and the like.

主权项

1. A computer-implemented method for establishing a stream application, comprising:
selecting a current optimization mode from a plurality of optimization modes based on at least one of a number of constraints, a type of each constraint, and a number of a plurality of compute nodes; selecting, by operation of one or more computer processors, a processing element from a plurality of processing elements in the stream application based on at least one processing element selection criteria; determining, based on one or more constraints, a plurality of candidate compute nodes to which the processing element can be allocated from among a plurality of compute nodes; selecting, based on at least one compute node selection criteria, a compute node from the candidate compute nodes, wherein at least one of the processing element selection criteria and the compute node selection criteria is determined by a current optimization mode for the stream application; and allocating the processing element to the selected compute node.