FILTERING AUTOMATED SELECTION OF HASHTAGS FOR COMPUTER MODELING

摘要

A social networking system receives messages from users that include hashtags. The social networking system may use a natural language model to identify terms in the hashtag corresponding to words or phrases of the hashtag. The words or phrases may be used to modify a string of the hashtag. The social networking system may also generate computer models to determine likely membership of a message with various hashtags. Prior to generating the computer models, the social networking system may filter certain hashtags from eligibility for computer modeling, particularly hashtags that are not frequently used or that more typically appear as normal text in a message instead of as a hashtag. The social networking system may also calibrate the computer model outputs by comparing a test message output with outputs of a calibration group that includes positive and negative examples with respect to the computer model output.

主权项

1. A method comprising:
identifying a plurality of hashtags associated with a set of messages in a social networking system; applying one or more exclusionary filters to identify a set of eligible hashtags by excluding hashtags in the plurality of hashtags that meet at least one of the exclusionary filters; training a plurality of hashtag classifiers, each hashtag classifier corresponding to an eligible hashtag in the set of eligible hashtags, the hashtag classifier providing a classifier output indicating whether a message should be associated with the hashtag corresponding to the hashtag classifier; and identifying one or more hashtags for a subject message based on the classifier outputs of the plurality of hashtag classifiers applied to the subject message.