发明名称 Testing and training a question-answering system
摘要 An approach is provided for an information handling system that includes a processor and a memory to improve the quality of question-answer sets used as inputs to a question-answering (QA) system. In the approach, a question-answer pair is analyzed using natural language processing (NLP) components. Some of the NLP components may be taken from the QA system whose input is being analyzed The question-answer pair includes a question and an answer to the question. Based on the analysis, one or more shortcomings of the question-answer pair are identified. The shortcomings relate to an ability of the target QA system to analyze the question. A human-readable feedback is provided to a user. The feedback recommends one or more possible actions to address the identified shortcomings.
申请公布号 US9460085(B2) 申请公布日期 2016.10.04
申请号 US201314100533 申请日期 2013.12.09
申请人 International Business Machines Corporation 发明人 Barbetta Jacqueline T.;Fallside David C.;Logsdon Drew A.;Parente Peter J.
分类号 G06N5/04;G06Q30/02;G06Q10/10;G06F17/28;G06F17/27;G06Q30/00 主分类号 G06N5/04
代理机构 VanLeeuwen & Vanleeuwen 代理人 VanLeeuwen & Vanleeuwen
主权项 1. A method, in an information handling system comprising a processor and a memory, of improving a quality of question-answer sets used as inputs to a question-answering (QA) system, the method comprising: receiving, from a user interface that is utilized by a user, a question-answer pair; analyzing the question-answer pair using natural language processing (NLP) components, wherein the question-answer pair includes a question and an answer to the question, and wherein at least one of the NLP components is a configurable analyzer extension; identifying, based on the analysis, one or more shortcomings of the question-answer pair, wherein the shortcomings relate to an ability of the target QA system to analyze the question; providing a human-readable feedback to the user by transmitting the human-readable feedback to the user interface, wherein the feedback recommends one or more possible actions to address the identified shortcomings; and receiving, from the user interface, a modified question-answer pair input by the user, wherein the modified question-answer pair addresses at least one of the shortcoming by performing at least one of the possible actions included in the human-readable feedback.
地址 Armonk NY US
您可能感兴趣的专利