Method and system for transformation of logical data objects for storage

摘要

A method and system for transforming a logical data object for storage in a storage device operable with at least one storage protocol, creating, reading, writing, optimization and restoring thereof. Transforming the logical data object comprises creating in the storage device a transformed logical data object comprising a header and one or more allocated accommodation sections with predefined size; processing one or more sequentially obtained chunks corresponding to the transforming logical data object thus giving rise to the processed data chunks, wherein at least one of said processed data chunks comprises transformed data resulting from said processing; sequentially accommodating the processed data chunks into said accommodation sections in accordance with an order the chunks received, and generating at least one index section constituting a part of the transformed logical data object, said index section comprising one or more entries containing indicators to physical storage location of respective accommodation sections and, with respect to each processed data chunk, one or more records related to said chunk, wherein said records indicate offset and length of data in the logical data object to be read from the respective processed data chunk, and are associated with a time stamp indicating time of creating said record. The method further facilitates reading a data range from the transformed logical object in response to a read request specifying desired point in time to be read.

主权项

1. A method of transforming a logical data object for storage in a storage device operable with at least one storage protocol, said method comprising:
in response to a respective request, creating in the storage device a transformed logical data object comprising a header and one or more allocated accommodation sections with a predefined size; comparing a characteristic of a plurality of sequentially obtained, variable size data chunks corresponding to the logical data object to a predefined criterion related to an estimated or actual time of transformation of the plurality of data chunks, the predefined criterion including an estimated time necessary to transform data which, being transformed, would substantially amount to a transformed section size; if the characteristic matches the predefined criterion:
transforming the plurality of data chunks to create a plurality of transformed data chunks, wherein at least two transformed data chunks comprise different sizes subsequent to transformation, andaccumulating the plurality of transformed data chunks in a first accommodation section until the first accommodation section is filled to the predefined size; if the characteristic does not match the predefined criterion:
identifying the plurality of data chunks as being in a non-transformed form or a partly transformed form, wherein the non-transformed or partly transformed plurality of data chunks are data chunks in which transformation was interrupted, andaccumulating the non-transformed or partly transformed plurality of data chunks in a second accommodation section until the second accommodation section is filled to the predefined size; and generating at least one index section constituting a part of the transformed logical data object, said index section comprising one or more entries containing indicators to physical storage location of the accumulated plurality of transformed data chunks, non-transformed data chunks, or partly transformed data chunks and, with respect to each accumulated data chunk, one or more records related to each accumulated data chunk, wherein said one or more records indicate offset and length of data in the logical data object to be read from each accommodation section, and are associated with a time stamp indicating time of creating said one or more records.