Real time content searching in social network

摘要

Indexing and retrieving real time content in a social networking system is disclosed. A user-term index includes user-term partitions, each user-term partition comprising temporal databases. As a post is received from a user, a user identifier, a post identifier, and a post is extracted. An object store communicatively coupled to a temporal database for recently received content is queried to determine whether terms in the post has already been stored. A term identifier is stored in the user-term index with the user and post identifiers. A forward index stores the post by post identifier. Responsive to a search query, the user-term index is searched by the user's connections and the terms. A real time search engine compiles the results of the user-term index query and retrieves the stored posts from the forward index. The search results may then be ranked and cached before presentation to the searching user.

主权项

1. A method comprising:
receiving a post from a user; determining a user identifier associated with the user, a post identifier associated with the post, and a term identifier associated with a term in the post; selecting a partition of a user-term index that is associated with the user identifier from among a plurality of partitions of the user-term index, the partition comprising a plurality of database shards organized by time; selecting a record in a most recent database shard of the of a plurality of database shards, the record comprising the user identifier, the term identifier, and a list of post identifiers; and adding the post identifier into the list of post identifiers of the selected record in the most recent database shard.