发明名称 | Testing and training a question-answering system | ||
摘要 | An approach is provided for an information handling system that includes a processor and a memory to improve the quality of question-answer sets used as inputs to a question-answering (QA) system. In the approach, a question-answer pair is analyzed using natural language processing (NLP) components. Some of the NLP components may be taken from the QA system whose input is being analyzed The question-answer pair includes a question and an answer to the question. Based on the analysis, one or more shortcomings of the question-answer pair are identified. The shortcomings relate to an ability of the target QA system to analyze the question. A human-readable feedback is provided to a user. The feedback recommends one or more possible actions to address the identified shortcomings. | ||
申请公布号 | US9460085(B2) | 申请公布日期 | 2016.10.04 |
申请号 | US201314100533 | 申请日期 | 2013.12.09 |
申请人 | International Business Machines Corporation | 发明人 | Barbetta Jacqueline T.;Fallside David C.;Logsdon Drew A.;Parente Peter J. |
分类号 | G06N5/04;G06Q30/02;G06Q10/10;G06F17/28;G06F17/27;G06Q30/00 | 主分类号 | G06N5/04 |
代理机构 | VanLeeuwen & Vanleeuwen | 代理人 | VanLeeuwen & Vanleeuwen |
主权项 | 1. A method, in an information handling system comprising a processor and a memory, of improving a quality of question-answer sets used as inputs to a question-answering (QA) system, the method comprising: receiving, from a user interface that is utilized by a user, a question-answer pair; analyzing the question-answer pair using natural language processing (NLP) components, wherein the question-answer pair includes a question and an answer to the question, and wherein at least one of the NLP components is a configurable analyzer extension; identifying, based on the analysis, one or more shortcomings of the question-answer pair, wherein the shortcomings relate to an ability of the target QA system to analyze the question; providing a human-readable feedback to the user by transmitting the human-readable feedback to the user interface, wherein the feedback recommends one or more possible actions to address the identified shortcomings; and receiving, from the user interface, a modified question-answer pair input by the user, wherein the modified question-answer pair addresses at least one of the shortcoming by performing at least one of the possible actions included in the human-readable feedback. | ||
地址 | Armonk NY US |