TWO LEVEL ADDRESSING IN STORAGE CLUSTERS

摘要

Digital objects are stored and accessed within a fixed content storage cluster by using a page mapping table and a pages index. A stream is read from the cluster by using a portion of its unique identifier as a key into the page mapping table. The page mapping table indicates a node holding a pages index indicating where the stream is stored. A stream is written by storing the stream on any suitable node and then updating a pages index stored within the cluster responsible for knowing the location of digital objects having unique identifiers that fall within a particular address range. The cluster recovers from a node failure by first replicating streams from the failed node and reallocating a page mapping table to create a new pages index. The remaining nodes send records of the unique identifiers corresponding to objects they hold to the new pages index.

主权项

1. A method of reading a digital object from a storage cluster, said method comprising:
receiving a unique identifier at a first computer node within a storage cluster having a plurality of computer nodes; identifying a first portion of said unique identifier whose value represents a first range of addresses within said address space; mapping said value indicated by said first portion of said unique identifier to identify a second computer node; accessing a second disk index in RAM on said second computer node using said unique identifier to identify a third computer node where said digital object is stored, said second disk index including unique identifiers of digital objects stored on said second computer node and locations on disk of said digital objects; accessing a third disk index in RAM on said third computer node using said unique identifier to identify where on disk of said third computer node said digital object is stored, said third disk index including unique identifiers of digital objects stored on said third computer node and locations on disk of said digital objects; and reading said digital object identified by said unique identifier from said third computer node and returning said digital object to a software application.