INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, PROGRAM, AND STORAGE MEDIUM

摘要

To appropriately and simply conduct an acceptance-or-rejection judgment whether a new algorithm is capable of minimum search performance that can be used in a comparison test under an actual environment or not regarding a version upgrade of a search engine. Under a preliminary environment, test searches with a current algorithm and a new algorithm are performed. Based on evaluation values related to rankings of the searches calculated based on these results, a first evaluation value for the current algorithm and a second evaluation value for the new algorithm are acquired. A control is performed to present relative evaluation information of the new algorithm with respect to the current algorithm based on these first evaluation value and second evaluation value. The evaluation values related to the rankings are calculated based on relevance corresponding information. In the relevance corresponding information, a relevance score is made to correspond to a test query of a test content data item for each set of the test query and the test content data item related to this test query.