发明名称 |
Long term metrics applied to multivariate testing |
摘要 |
A set of variations of a user experience on a subscription-based online site are tested, where each of the set of variations is distinct from other variations in the set of variations. Each of a group of users is assigned to one of the set of variations. For each user request received during a predetermined window of time, one of the set of variations is determined for use in processing the user request, based on a user associated with the user request, and the respective user request is processed using the determined variation. Long-term user metric information relating to subscription services for the subscription-based online site is determined, with respect to the group of users. At least one of the set of variations is then rated based on the determined long-term user metric information. |
申请公布号 |
US9319297(B2) |
申请公布日期 |
2016.04.19 |
申请号 |
US201313800558 |
申请日期 |
2013.03.13 |
申请人 |
NETFLIX, Inc. |
发明人 |
Aurisset Juliette |
分类号 |
G06F15/173;H04L12/26;H04L12/24 |
主分类号 |
G06F15/173 |
代理机构 |
Artegis Law Group, LLP |
代理人 |
Artegis Law Group, LLP |
主权项 |
1. A method of testing a plurality of variations of a user experience on a subscription-based online site, wherein each of the plurality of variations is distinct from other variations in the plurality of variations, comprising:
assigning each of a plurality of users to one of the plurality of variations of the user experience; for each of a plurality of user requests received from the plurality of users during a predetermined window of time:
determining one of the plurality of variations for use in processing the user request, based on a user associated with the user request, andprocessing the respective user request using the determined variation; and determining long-term user metric information relating to subscription services for the subscription-based online site, with respect to the plurality of users, and for each of the plurality of variations. |
地址 |
Los Gatos CA US |