Providing distributed array containers for programming objects

摘要

Object serialization is used to communicate references regarding shim objects. Shim objects are instantiated on one or more ranks of a distributed software application. The shim objects store a registration object in a distributed object cache for each rank. The registration object includes a unique identifier for a distributed array object and a reference to a local portion of the distributed array. The shim objects are serialized for communication of the stored references from a master rank of the distributed application to one or more worker ranks of the distributed application. Upon serializing the shim objects, the shim object's stored references are communicated from the distributed object cache for that rank to the one or more worker ranks of the distributed application. The shim objects are subsequently removed so that references to the underlying distributed array object are also removed, and memory previously allocated to the unique identifier is recoverable.

主权项

1. A computer system, comprising:
one or more processors; and one or more computer-readable storage media having stored thereon computer-executable instructions that are executable by the one or more processors to cause the computer system to use object serialization to communicate references to shim objects, the computer-executable instructions including instructions that are executable to cause the computer system to perform at least the following:
instantiate shim objects on one or more ranks of a distributed software application, the shim objects being configured to store a registration object in a distributed object cache for each rank, the registration object including a unique identifier for a distributed array object and a reference to a local portion of the distributed array, the shim objects being instantiated in response to receiving an indication that a distributed function has been invoked on a master process of the distributed software application;serialize the shim objects for communication of the stored references from a master rank of the distributed application to one or more worker ranks of the distributed application;upon serializing the shim objects, communicate the shim object's stored references from the distributed object cache for that rank to the one or more worker ranks of the distributed application;determine that a distributed array destructor has been invoked on the master process; andremove the shim objects from the distributed object cache on each process of the distributed application, such that references to the underlying distributed array object are removed, and memory previously allocated to the unique identifier is recoverable.