Supporting big data in enterprise content management systems

摘要

Provided are a method, computer program product, and system for storing a data stream. A distributed library server is configured with a plurality of data servers. A data type is mapped to at least one of the plurality of data servers. A portion of a data stream containing data of the data type is selected. An object part including the portion of the data stream is generated, and the object part is stored at one of the data servers mapped to the data.

主权项

1. A computer implemented method for storing a data stream, comprising:
providing a big data enterprise content management system with a distributed library server, a plurality of data servers, and a big data stream processor, wherein the distributed library server includes 1) a library server main node that includes a data type table that identifies data types and a node table and 2) a plurality of library server nodes, wherein each of the library server nodes contains a logical metadata table, and wherein the logical metadata table is comprised of physical metadata tables that describe storage locations for object parts, by at least one computing processor of a computing system; mapping a data type to at least one of the plurality of data servers, by the at least one computing processor of the computing system by:
identifying the data type among the data types in the data type table;identifying a logical metadata table of one of the library server nodes using the data type table;identifying a physical metadata table using the logical metadata table, wherein the physical metadata table identifies a node; andusing the node table to map the node identified in the physical metadata table to the at least one of the plurality of data servers; selecting a portion of the data stream containing data of the data type, by the at least one computing processor of the computing system; generating an object part including the portion of the data stream, by the at least one computing processor of the computing system; and storing the object part at the at least one of the plurality of data servers mapped to the data type of the data, by the at least one computing processor of the computing system.