Non-disruptive data movement and node rebalancing in extreme OLTP environments

摘要

Systems and methods for non-disruptive cache startup, shutdown, data partition movement, and node rebalancing for a data fabric within a data grid in a database environment. The data grid is a clustered in-memory database (IMDB) cache comprising one or more data fabrics including multiple IMDB cache nodes. The method takes a time tag and moves data from source to destination nodes while allowing updates to data on the source nodes. The method propagates updates occurring after the time tag to destination nodes from source nodes and switches applications and ownership to the destination nodes. Another method slices data for a partitioned fabric and stores slices on nodes. Another method starts a data fabric by moving data from a grid backend to the nodes. In an embodiment, another method rebalances nodes in a non-disruptive manner. When a fabric is shutdown, the method saves data from the nodes to the grid backend.

主权项

1. A method, comprising:
moving a data partition containing a data page, in response to a request for moving the data partition, from a source node to a destination node while simultaneously allowing an application read and write access to the data partition on the source node, wherein the source node retains ownership of the data partition; propagating data changes from the source node to the destination node, wherein the data changes were applied by the application to the data partition on the source node during the moving; iteratively propagating additional data changes from the source node to the destination node until a number of remaining additional data changes is below a threshold value, wherein the additional data changes were applied by the application to the data partition on the source node during a previous propagation; limiting the read and write access of the application to the source node containing the data partition at the conclusion of the iterative propagation; instructing the application to perform future read and write operations on the destination node; switching ownership of the data partition to the destination node; and resuming the read and write access of the application to the data partition.