Efficient data storage system

摘要

A system and method are disclosed for providing efficient data storage. A plurality of data segments is received in a data stream. The system determines whether a data segment has been stored previously in a low latency memory. In the event that the data segment is determined to have been stored previously, an identifier for the previously stored data segment is returned.

主权项

1. A system for storing data comprising:
an interface to receive a data stream comprising a plurality of data segments; and a processor to:
determine whether one data segment of the plurality of data segments has been stored previously in a low latency memory;in the event that the one data segment is determined to have been stored previously, confirm whether the one data segment has been stored;in the event that the one data segment is determined to have not been stored previously in the low latency memory or in the event that the one data segment is confirmed to not have been stored, store the one data segment, wherein storing the one data segment comprises storing the one data segment in a segment database, wherein the segment database includes a metadata index, and wherein storing the one data segment comprises storing metadata for the one data segment in the metadata index.