SYSTEM AND APPARATUS FOR EFFECTIVE COORDINATION AND SCHEDULING OF ACCESSES TO RATE LIMITED ONLINE SITES TO OBTAIN DATA FOR USE IN ASSESSING SOCIAL METRICS BASED ON DOMAIN TAILORED EVALUATION OF SOCIAL MEDIA EXPOSURE

摘要

Embodiments described herein can be employed in a social media analytics platform to monitor which data has been acquired for entities from online sites at which entities may maintain an account, including social media platforms by continually moderating, coordinating or scheduling requests for data retrieval across the online sites to substantially maximize the data pulled from each site, and the freshness of that data, given any imposed rate limits associated with those online sites without slowing or idling the social media analytics platform. This results in increased efficiencies in time and expense and a simultaneous reduction in the number of errors received from the online sites, as the analytics platform can spread out requests over time and fully utilize parallel update processes in a way that respects the rate limiting while still improving freshness of data given that rate limiting.

主权项

1. A system, comprising:
a social media analytics platform coupled to each of one of more online sites over a network, wherein the one or more online sites include at least one social media site and each online site provides a proprietary interface for requesting data from that online site, the social media analytics platform configured with a plurality of entities, each entity having an account at each of the online sites, wherein the social media analytics platform is further configured such that each of the one of more online sites is associated with rate limiting data defining a number of requests and a time period for that online site, and the social media analytics platform comprises:
a data store storing a historical snapshot for each account for each entity, wherein each historical snapshot is associated with a timestamp;a database manager operable to determine a final number of accounts that were least recently updated by:
determining at least one online site of the one or more online sites for which a rate limit has not been reached based on the rate limiting data associated with each online site;identifying a number of accounts associated with each of the at least one online site that were least recently updated;identifying a final number of accounts associated from the number of accounts associated with each of the at least one online site;an update process module operable to update the data store with values associated with accounts of entities by:
determining a plurality of accounts to update from the final number of accounts, where each account of the plurality of accounts is associated with an entity of the plurality of entities and one of the online sites;for each account of the plurality of accounts:
forming a request for a plurality of data points associated with the online site associated with the account, wherein the request conforms to the proprietary interface provided by that online site and requests values for the plurality of data points associated with the online site for the entity associated with the account;sending the request to the online site associated with the account over the network;receiving a response to the request, where the response includes a value returned by the associated online site for each of the plurality of data points associated with the online site associated with the account; andstoring the value for each of the plurality of data points received from the online site as a historical snapshot in the data store in association with the entity and the account.