System and method for adaptively collecting performance and event information

摘要

Determination of an optimum batch size for aggregating data wherein, for a number of batch sizes, costs are estimated for sending batched information to persistent storage and for losing batched data. Then, the optimum batch size is selected from the number of different batch sizes based on sums of these costs.

主权项

1. A method for determining a batch size for aggregating data comprising the steps of:
estimating first costs, as a function of different sizes, for sending data to one of the following: a storage device and a computing node; estimating second costs, as a function of different sizes, for losing said data; and selecting said batch size based on said estimated first and second costs, the steps of the estimating and selecting performed by an information logger executing on one or more processors, and receiving performance data of an application process executing on one or more of the processors, wherein the performance data is aggregated based on the selected batch size.