SYSTEMS, METHODS, AND DEVICES FOR SCALABLE DATA PROCESSING

摘要

Systems, methods, and devices are disclosed for scalable integration of data events received from data providers. Systems include data aggregators configured to receive data records generated by data providers and user profile data generated by an online advertisement service provider. The data records and the user profile data each identify data events and users. Systems include data provider record generators configured to generate first data provider records and second data provider records based on identifiers included in the data records and user profile data. Systems include partition record generators configured to generate provider partition records based on the first data provider records, and mapping partition records based on the second data provider records. The mapping partition records may include a second user identifier mapping. Systems include partition record analyzers configured to generate new data events based on the second user identifier mapping and contents of the provider partition records.

主权项

1. A system comprising:
a data aggregator configured to receive a plurality of data records generated by at least one data provider, and the data aggregator being further configured to receive user profile data generated by an online advertisement service provider, the plurality of data records and the user profile data each identifying at least one data event and at least one user, and the user profile data including a first user identifier mapping; a data provider record generator configured to generate a first plurality of data provider records based on a first plurality of identifiers included in the plurality of data records, and the data provider record generator being further configured to generate a second plurality of data provider records based on a second plurality of identifiers included in the user profile data; a partition record generator configured to generate a plurality of provider partition records based on the first plurality of data provider records, and the partition record generator being further configured to generate a plurality of mapping partition records based on the second plurality of data provider records, the plurality of mapping partition records including a second user identifier mapping; and a partition record analyzer configured to generate a plurality of new data events based on the second user identifier mapping represented in the plurality of mapping partition records and at least some of the plurality of provider partition records, the partition record analyzer being further configured to update the user profile data based on a combination of at least some of the plurality of new data events and at least some of the user profile data.