Optimizing storage in a publish / subscribe environment

摘要

Creating message files in a publication subscription computer system by: (i) receiving data corresponding to a first message; (ii) receiving a list of subscribers that subscribe to a topic of the first message; and (iii) creating a digital data file that includes a payload data and a consumption metadata. The payload data includes content data corresponding to the first message. The consumption metadata includes data relating to whether one or more subscribers of the list of subscribers will potentially consume the first message at a later period in time from the time of receiving the content data corresponding to the first message.

主权项

1. A method of creating machine readable message files in a publication subscription system implemented with a plurality of computers, the method comprising:
receiving data corresponding to a first message; receiving a list identifying a plurality of subscribers that subscribe to a topic of the first message; creating a machine readable data file that includes a payload data and a consumption metadata, with: (i) the payload data including content data corresponding to the first message, and (ii) the consumption metadata including data indicating whether each subscriber of the plurality of subscribers has respectively consumed the first message; storing a master copy of the machine readable data file in a persistent storage database; each time a subscriber of the plurality of subscribers consumes the first message, updating the consumption metadata to indicate consumption of the first message by the subscriber; determining that all subscribers of the plurality of subscribers have consumed the first message based on the consumption metadata; and on condition of a determination that all subscribers have consumed the first message, deleting the master copy of the machine readable data file from the persistent storage database; wherein the consumption metadata includes a binary bit to respectively indicate consumption status for each subscriber of the plurality of subscribers.