Batch processing and data synchronization in cloud-based systems

摘要

Disclosed are methods and apparatus for efficiently storing application data received from clients in a database stored on a server, such as a cloud-based database. The methods include receiving a batch of a plurality of web operations that specify actions to be performed on data objects that represent application data stored in a cloud database, translating the web operations to a batch of data storage operation sets, creating a temporary database having a subset of contents of the cloud database, applying the data storage operation sets to the temporary database, recording database operations generated by the temporary database based on the plurality of data storage operation sets, and applying the plurality of database operations to the cloud database in a transaction. Translating the web operations can include mapping the actions to be performed on the data objects to transactions to be performed on the cloud database.

主权项

1. A method, comprising:
by a computer device:
receiving a batch of web operations that specify an action to be performed on application data stored in a cloud database, wherein the batch of web operations comprises one or more constraints associated with a database state;generating a temporary database in response to receiving the batch of web operations, wherein the temporary database includes data copied from the cloud database;removing the one or more constraints from the batch of web operations to yield a modified batch of web operations;translating the modified batch of web operations to a first set of database operations that are compatible with a data storage interface of the cloud database;applying the first set of database operations to the temporary database;generating, in response to applying the first set of database operations to the temporary database, a second set of database operations based on the first set of database operations applied to the temporary database;re-applying the one or more constraints to the second set of database operations; andapplying the second set of database operations with the one or more constraints to the cloud database.