Systems and methods for prediction-based crawling of social media network

摘要

A new approach is proposed that contemplates systems and methods to support efficient crawling of a social media network based on predicted future activities of each user on the social network. First, data related to a user's past activities on a social network are collected and a pattern of the user's past activities over time on the social network is established. Based on the established pattern on the user's past activities, predictions about the user's future activities on the social network can be established. Such predictions can then be used to determine the collection schedule - timing and frequency - to collect data on the user's activities for future crawling of the social network.