Virtual accounting container for supporting small volumes of data

摘要

Embodiments of the present invention provide a method for storing small volumes of data within a grid-scale storage system. The method includes creating a container within a storage disk. The method includes distributing data evenly between storage disks. A partition is created within the container. Data is received and stored in the partition, wherein the partition is at least as large as the data. The method may also include setting an offset associated with the partition to allow for partition expansion.

主权项

1. A computer system comprising:
one or more computer processors; one or more non-transitory computer readable storage media; program instructions stored on the one or more non-transitory computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising: in a grid-scale storage system comprising 180 storage disks, and 16,411 slices where the 16,411 slices are distributed across the 180 storage disks, program instructions to identify the size of a slice of the 16,411 slices, wherein the slice size is equal to:
(the maximum number of storage disks)*(size of each of the storage disks)/(total number of slices), wherein the maximum number of storage disks is 180, the size of each of the storage disks is 1 TB, and the total number of slices is 16,411; program instructions to create a container within a slice of the 16,411 slices distributed across the 180 storage disks, wherein creating the container comprises:
program instructions to set a first offset within said container to be associated with a first created partition; andprogram instructions to set a second offset within said container to be associated with a second created partition, wherein said second offset is configured to allow said first created partition to be expanded; program instructions to create said first partition within said container, wherein said first partition is identified as a logical unit number (LUN); program instructions to receive a fragment of data; program instructions to store said fragment of data in said first partition, wherein said first partition is at least as large as a size of the fragment of data; responsive to storing the fragment of data, program instructions to recalculate an updated amount of available storage space in the 180 storage disks, wherein the updated amount of available storage space in the 180 storage disks is equal to:
(a minimum LUN size)−(a size of the LUN+storage space of said second offset configured to allow said first created partition to be expanded), wherein the program instructions to recalculate the updated amount of available storage space comprise:
program instructions to calculate offsets for the first and second partitions within said container; andprogram instructions to calculate maximum sizes for the first and second partitions within said container; and wherein the program instructions to recalculate the updated amount of available storage space comprise program instructions to maintain an even distribution of a set of data across the plurality of storage disks and the first and the second partitions.