Data transfer optimization

摘要

A dataset structure that is suitable for transferring data between service components may include a table having one or more rows and a plurality of columns. The table may be defined by a schema for an entity type. The schema may include a corresponding column definition for each column. Each of the rows may store a tuple of information that conforms to the entity type defined by the schema. A data transfer component may use the dataset structure to transfer data between the service components.

主权项

1. A computer-implemented method, comprising:
under control of one or more servers configured with executable instructions, storing data in a table having a plurality of rows and a plurality of columns, individual rows storing a tuple of information that conforms to an entity type defined by a schema, the schema including a corresponding column definition for individual columns; storing the plurality of rows in the table that have a variable row size or a fixed row size into a plurality of pages, at least one row of data in a page having the variable row size being positioned using a corresponding unique absolute offset value and at least one corresponding unique column offset value, and at least one row of data in a page having the fixed row size being positioned using a corresponding unique absolute offset value and at least one common column offset value that is identical for the plurality of rows; and modifying a particular row to include at least one more byte of data or at least one less byte of data; adjusting an absolute offset of an additional row that follows the particular row based on a change in an amount of bytes in the particular row due to modification of the particular row while maintaining a relative offset of the additional row as unchanged; and updating a page that includes the particular row with a page revision number that indicates that the particular row of the page is modified.