Ranking Test Framework for Search Results on an Online Social Network

摘要

In one embodiment, a method includes accessing a social graph comprising a plurality of nodes and edges, receiving a set of scored results from a user that include results generated by a search algorithm in response to a query from the user and a score for each result, where each result corresponds to a node of the social graph, calculating a gain for each result based on the score of the result, and modifying the search algorithm based on the calculated gain.

主权项

1. A method comprising, by a computing device:
accessing a social graph comprising a plurality of nodes and a plurality of edges connecting the nodes, each of the edges between two of the nodes representing a single degree of separation between them, the nodes comprising:
a first-user node corresponding to a first user associated with an online social network; anda plurality of second nodes that each correspond to a concept or a second user associated with the online social network; receiving a first set of scored results from the first user comprising:
one or more results generated by a first search algorithm in response to a query from the first user, wherein each result corresponds to one of the second nodes; andone or more scores corresponding to the one or more results, respectively; calculating a gain for each result in the first set of scored results based on the score corresponding to the result; and modifying the first search algorithm based on the calculated gain for each result.