发明名称 |
OFFLINE EVALUATION OF RANKING FUNCTIONS |
摘要 |
The claimed subject matter includes techniques for offline evaluation of ranking functions. An example system includes a first module configured to receive production log data, the first module to pre-process the production log data to generate an exploration data set. The example system also includes a second module configured to perform offline estimation of online metrics for ranking functions using the exploration data set. The example system also includes a third module to evaluate a proposed ranking function by comparing the estimated online metrics to a set of baseline metrics of a baseline ranking function and detecting that the estimated online metrics of the proposed ranking function exceed, are lower than, or are within a predetermined range of the baseline metrics. |
申请公布号 |
US2016147754(A1) |
申请公布日期 |
2016.05.26 |
申请号 |
US201414550640 |
申请日期 |
2014.11.21 |
申请人 |
Microsoft Corporation |
发明人 |
Li Lihong;Kim Jinyoung;Zitouni Imed |
分类号 |
G06F17/30;H04L29/08 |
主分类号 |
G06F17/30 |
代理机构 |
|
代理人 |
|
主权项 |
1. A system for offline evaluation of ranking functions, comprising:
a first module configured to receive production log data, the first module to pre-process the production log data to generate an exploration data set; a second module configured to perform offline estimation of online metrics for ranking functions using the exploration data set; and a third module to evaluate a proposed ranking function by comparing the estimated online metrics to a set of baseline metrics of a baseline ranking function and detecting that the estimated online metrics of the proposed ranking function exceed, are lower than, or are within a predetermined range of the baseline metrics. |
地址 |
Redmond WA US |