Evaluating recommendations

摘要

Generally described, embodiments of the present disclosure are directed toward the identification of items for inclusion in a recommendations list that may be displayed concurrently with an item selected by a user or users. The recommended items may be items that are of potential interest to the user and/or may be items that are related to the selected item. More specifically, embodiments of the present disclosure provide a method and system for generating one or more recommendations lists, providing those lists to users, evaluating users' interactions with those lists, and modifying the engines or techniques used to identify items that are to be included in the recommendations lists.

主权项

1. A computer-implemented method for evaluating recommendations, the method comprising:
generating a first set of recommendations including a first plurality of items, wherein the first plurality of items is identified by a first technique using a first set of inputs; generating a second set of recommendations including a second plurality of items, wherein the second plurality of items is identified by a second technique using a second set of inputs; determining a first set of end user actions, wherein each of the first set of end user actions corresponds to an action taken by an end user in response to a display corresponding to at least one item of the first set of recommendations; determining a second set of end user actions, wherein each of the second set of end user actions corresponds to an action taken by an end user in response to a display corresponding to at least one item of the second set of recommendations; and associating a performance value with the first set of recommendations based at least in part on a comparison of the first set of end user actions and the second set of end user actions.