| 主权项 |
1. A method of detecting if a change in user interactivity has occurred between a first and a second version of a SERP, the second version of the SERP being a modified version of the SERP, the method executable at a server, the method comprising:
presenting the first version of the SERP to a first set of users and the second version of the SERP to a second set of users; assessing first measures and second measures of user interactions with the first and the second version of the SERP respectively, the user interactions being of a pre-selected type of user interactions; computing a first and a second distribution of the first measures and the second measures of user interactions, respectively; analyzing the first and the second distribution conjointly for determining a magnitude of the change in user interactivity, the analyzing comprises:
determining a set of ratios, each ratio within the set of ratios being the ratio between a value of the first distribution and a corresponding value of the second distribution for each measure of user interaction, respectively;determining a lowest ratio and a highest ratio within the set of ratios, the lowest ratio being indicative of a smallest relative change between the first and the second distributions and the highest ratio being indicative of a largest relative change between the first and the second distributions;determining the magnitude of the change in user interactivity based on a combination of the lowest ratio and the highest ratio; anddetermining a statistical significance of the magnitude of the change in user interactivity; responsive to the magnitude of the change in user interactivity being statistically significant, determining that the change in user interactivity has occurred between the first and the second version of the SERP. |
