Processing element data sharing

摘要

A memory sharing method and system in a distributed computing environment. The method includes placing a first operator and a second operator within a processing element. The first operator is associated with a first host and the second operator associated with a second and differing host of a distributed computing system. Requests for usage of global data with respect to multiple processes are received from the first operator and the second operator. The global data is stored within a specified segment of a shared memory module that includes shared memory space being shared by the first operator and the second operator. The multiple processes are executed and results are generated by the first operator and the second operator with respect to the global data.

主权项

1. A method comprising:
placing, by a computer processor, a first operator and a second operator within a first processing element of said computer processor, said first operator comprising first local data, said second operator comprising second local data, said first operator associated with a first host of a distributed computing system, said second operator associated with a second host of said distributed computing system, said first host differing from said second host; receiving, by said computer processor from said first operator within said first processing element, a first request for usage of first global data with respect to a first process, said first global data semi-persistently stored within a specified segment of a shared memory module; passing, by said computer processor, said first global data through a split operator module; first executing in response to said first request via said split operator module, by said computer processor executing said first operator within said first processing element, said first process with respect to said first global data semi-persistently stored within said specified segment of said shared memory module, wherein said shared memory module comprises a RAM stack; generating, by said computer processor, results of said first executing; receiving, by said computer processor from said second operator within said first processing element, a second request for usage of said first global data with respect to a second process differing from said first process; second executing in response to said second request via said split operator module, by said computer processor executing said second operator within said second processing element, said second process with respect to said first global data semi-persistently stored within said specified segment of said shared memory module, wherein said shared memory module comprises shared memory space being shared by said first operator and said second operator; generating, by said computer processor, results of said second executing; controlling, by said computer processor executing an application control master module, write functions of said first process and said second process, wherein said application control master module is located external to said first host and said second host; controlling, by said computer processor executing said application control master module with respect to an application control slave module, read functions of said first process and said second process; initializing, by said computer processor executing said application control master module, a state change, for said shared memory module, from a run state to a stop state resulting in said first global data being overwritten and updated within said shared memory module; determining, by said computer processor, that said first global data has been overwritten and updated; and initializing, by said computer processor executing said application control master module, an additional state change, for said shared memory module, from said stop state to said run state.