Mobile hadoop clusters

摘要

Techniques for mobile clusters for collecting telemetry data and processing analytic tasks, are disclosed herein. The mobile cluster includes a processor, a plurality of data nodes and an analysis module. The data nodes receive and store a snapshot of at least a portion of data stored in a main Hadoop storage cluster and real-time acquired data received from a data capturing device. The analysis module is operatively coupled to the processor to process analytic tasks based on the snapshot and the real-time acquired data when the storage cluster is not connected to the main storage cluster.

主权项

1. A storage cluster, comprising:
a processor; a plurality of data nodes for receiving and storing a point-in-time image of at least a portion of data stored in a main storage cluster, that is separate from the storage cluster, and acquired data received from a data capturing device; and an analysis module operatively coupled to the processor to process analytic tasks based on the point-in-time image and the acquired data when the storage cluster is not connected to the main storage cluster for exchanging data; wherein the data nodes of the storage cluster are removable from the storage cluster and configured to be integrated into the main storage cluster, and in an event that the data nodes are integrated into the main storage cluster, the main storage cluster uses differences of file system metadata between the storage cluster and the main storage cluster to update a file system of the main storage cluster.