Efficient conversion of XML data into a model using persistent stores and parallelism

摘要

Methods for product data management and corresponding systems and computer-readable mediums. A method includes receiving an XML document by a parallel parser process, the XML document including a plurality of elements of an XML data structure that corresponds to an object model. The method includes dividing the XML document into a plurality of chunks using the parallel parser process, and parsing the plurality of chunks in parallel using separate parsing tasks to produce objects representing the elements and corresponding attributes. The method includes storing the objects and corresponding attributes in a persistent element store.

主权项

1. A method for product data management, the method performed by at least one data processing system and comprising:
receiving an XML document by a parallel parser process, the XML document including a plurality of elements of an XML data structure that corresponds to an object model; dividing the XML document into a plurality of chunks using the parallel parser process according to a chunking strategy comprising a determination of:
a number of chunks,a size of each chunk,an order in which the chunks will be parsed,an end point of a first chunk of the plurality of chunks, anda start point of a second chunk of the plurality of chunks, wherein the start point corresponds to the end point, andwherein the chunking strategy avoids processing the second chunk before the determination of the end point of the first chunk by processing non-adjacent chunks before adjacent chunks; parsing the plurality of chunks in parallel using separate parsing tasks to produce objects representing the elements and corresponding attributes; and storing the objects and corresponding attributes in a persistent element store.