Optimized transfer and storage of highly denormalized data in an in-memory data grid

摘要

A method for transferring and storing a data set associated with an in-memory data grid (IMDG) is provided. The method may include identifying at least two data object instances associated with the data set based on a determined relationship between the at least two data object instances. The method may also include performing a field relation analysis on the identified at least two data object instances and recording the field relation analysis. The method may include receiving a request for a data object associated with the data set. The method may include determining if an optimization can be performed on the data object. The method may include omitting a field value associated with the data object based on the determined optimization. The method may include inflating the omitted field value into the data set associated with the data object request and returning the data set with the inflated field value.

主权项

1. A computer system for transferring and storing a data set associated with an in-memory data grid (IMDG), the computer system comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising: in response to the data set being loaded into the IMDG associated with a first computer, identifying at least two data object instances associated with the loaded data set based on a determined relationship between the at least two data object instances, wherein the identifying occurs periodically; performing a field relation analysis on the identified at least two data object instances, wherein performing a field relation analysis comprises determining whether the identified at least two data object instances share a reference field value; prompting a user using a second computer to determine whether to optimize the identified at least two data instances sharing a reference field value; in response to the user determining to optimize the identified at least two data instances sharing a reference field value, recording the field relation analysis; receiving a request for a data object associated with the data set; determining if an optimization can be performed on the data object based on the recorded field relation analysis; omitting a field value associated with the data object based on the determined optimization; inflating the omitted field value into the data set associated with the data object request; returning the data set with the inflated field value; and recording a plurality of metadata associated with the received request, wherein the recorded metadata comprises a time the request was received, a time the data set was returned, an object type associated with the requested data object, and an ID associated with the requested data object.