INFORMATION RETRIEVAL EVALUATION DEVICE, INFORMATION RETRIEVAL EVALUATION METHOD, PROGRAM FOR INFORMATION RETRIEVAL EVALUATION DEVICE, AND STORAGE MEDIUM FOR INFORMATION RETRIEVAL EVALUATION DEVICE

摘要

PROBLEM TO BE SOLVED: To perform a proper evaluation even if relation is present between categories of a document assembly by enabling the evaluation of an information retrieval system taking not only a document but also an author, an organization, etc. as a retrieval question or retrieval object. SOLUTION: Input of a data item tree, a lower-order layer and an upper-order layer is accepted. The data item tree is divided to a lower-order category group and an upper-order category group. A question field, a question element, and a field of retrieval object are accepted. A conforming element group is extracted from the lower-order category group of a lower-order category storage means 2, and a non-conforming element group is extracted from the upper-order category group of an upper-order category storage means 3. For an information retrieval result of an information retrieval by an information retrieval system, the evaluation result of the system is calculated in reference to the adaptive element group in a conforming element storage means 4 and the non-conforming element group in a non-conforming element storage means 5. COPYRIGHT: (C)2004,JPO&NCIPI