SCALABLE EVENTUAL CONSISTENCY SYSTEM USING LOGICAL DOCUMENT JOURNALING

摘要

A scalable eventual consistency system. The system uses logical document journaling to provide eventual consistency across partitions in a large-scale service. The system allows for transactional edits to massively interconnected graphs of documents documents through parallelization without sacrificing linear scalability. The system separates the authority for edits from the replicated storage allowing efficient transactions and linear scalability. All document writes are written to document-specific partitions in a journal where they are queued until the changes are propagated to view-based partitions of a store. By continually checking the journal and attempting to replicate any pending document writes to the store, the system provides eventual consistency without complicated synchronization mechanisms. The system models membership and containment relationships between documents in manner allowing document writes ultimately impacting more than one document to be efficiently handled through the journal as an edit to a single document.