METHOD FOR TIGHTLY COUPLED SCALABLE BIG-DATA INTERACTION

摘要

Provided is a method for tightly coupled scalable big-data interaction; by means of constructing a distributed tightly coupled client driver layer and while ensuring consistency, single point failure of a client or server is avoided and the communication overhead between clients is reduced, causing a system to have near-linear scalability when based on metadata query class, satisfying the requirements of online high concurrency interaction and analysis. The described method ensures data read/write consistency; although delays occur with a read operation alone, the consistency in the order of read versions is ensured. When it is necessary to read the newest version, a data synchronization process may be executed proactively. Moreover, the method has good fault tolerance; as long as the number of failed nodes is less than half of the number of nodes, the read/write data of the other nodes is not affected; after a node responds, only one successful read/write operation is needed in order for synchronization to take place.