Methods and Systems for Block Sharding of Objects Stored in Distributed Storage System

摘要

The present disclosure provides systems and methods for sharding objects stored in a distributed storage system. In accordance with one embodiment disclosed herein, a block sharding technique is used. Block sharding is an advantageously efficient technique when dealing with random access objects, such as virtual disk drives or “volumes”. One embodiment disclosed herein provides a method of performing a delta edit of a named object stored in a distributed storage system in which a payload of the named object is stored in block shards defined by block-shard chunk references. The block shards store non-overlapping byte ranges of the payload of the named object. Another embodiment disclosed herein relates to a method of retrieving a portion of a named object stored in a distributed object storage system. Other embodiments, aspects and features are also disclosed.

主权项

1. A method of performing a delta edit of a named object stored in a distributed storage system, the method comprising:
storing, in the distributed storage system, a payload of the named object in block shards defined by block-shard chunk references, wherein the block shards store non-overlapping byte ranges of the payload of the named object; receiving, by a gateway server from a client, a request for a set of delta edits to be applied to the named object, wherein each delta edit specifies a change to the payload for the named object; determining, by the gateway server, the relevant block shards to which the delta edits apply; and updating, in the distributed storage system, the relevant block shards, while not updating other block shards for the named object.