ADAPTIVE CONTROL OF DATA COLLECTION REQUESTS SENT TO EXTERNAL DATA SOURCES

摘要

Techniques and mechanisms are disclosed that enable a data collection system to adaptively control collection of data from one or more external data sources. At a high level, adaptively controlling collection of data from external data sources may include collecting performance information related to one or more data collection nodes and, in response to analyzing the collected performance information, adapting rates at which the data collection nodes send data collection requests to external data sources. Data collection performance information generally may include, but is not limited to, network traffic data, error messages generated by external data sources and/or data collection nodes, computing device performance information, and any other types of information related to a data collection node's ability to collect data from external data sources.

主权项

1. A method, comprising:
receiving, by a controller node, data collection performance information from a data collection node of a plurality of data collection nodes, the data collection performance information related to data collection requests sent by the data collection node to a cloud computing service provider; generating, based on the data collection performance information, instructions for the data collection node to modify a rate at which the data collection node sends data collection requests to the cloud computing service provider; sending the instructions to the data collection node.