Systems and methods for transformation of logical data objects for storage

摘要

Systems and methods for transforming a logical data object for storage in a storage device operable with at least one storage protocol, creating, reading, writing, optimization and restoring thereof. Transforming the logical data object comprises creating in the storage device a transformed logical data object comprising one or more allocated storage sections with a predefined size; transforming one or more sequentially obtained chunks of obtained data corresponding to the transforming logical data object; and sequentially storing the processed data chunks into said storage sections in accordance with a receive order of said chunks, wherein said storage sections serve as atomic elements of transformation/de-transformation operations during input/output transactions on the logical data object. The processing may comprise two or more data transformation techniques coordinated in time, concurrently executing autonomous sets of instructions, and provided in a manner preserving the sequence of processing and storing the processed data chunks.

主权项

1. A method for recovery of a transformed logical data object including one or more transformed storage sections associated with one or more index sections, said method comprising:
recognizing, by a processor, a recovery status when opening the transformed logical data object; initiating a recovery process in response to recognizing said recovery status; searching the transformed logical object to determine if the transformed logical object comprises one or more non-indexed transformed storage sections, the one or more non-indexed transformed storage sections comprising at least one log that does not include a corresponding log record in any of the one or more index sections; de-transforming each transformed data chunk within the one or more non-indexed transformed storage sections associated with the at least one log to generate a de-transformed data chunk for each transformed data chunk, each transformed data chunk including a respective size and a respective data content; re-transforming each de-transformed data chunk to generate a re-transformed data chunk for each de-transformed data chunk; generating an entry in an index section of the one or more index sections for each re-transformed data chunk such that each transformed data chunk in the one or more non-indexed transformed storage sections is indexed in the index section; and storing each re-transformed data chunk in a transformed storage section on the one or more storage sections, wherein:
each re-transformed data chunk subsequent to the re-transforming process maintains the same respective size as its corresponding transformed data chunk prior to the de-transforming process, andeach re-transformed data chunk subsequent to the re-transforming process maintains the same respective data content as its corresponding transformed data chunk prior to the de-transforming process.