SYSTEMS AND METHODS FOR RESPONDING TO NATURAL LANGUAGE SPEECH UTTERANCE

摘要

Systems and methods are provided for receiving speech and non-speech communications of natural language questions and/or commands, transcribing the speech and non-speech communications to textual messages, and executing the questions and/or commands. The invention applies context, prior information, domain knowledge, and user specific profile data to achieve a natural environment for one or more users presenting questions or commands across multiple domains. The systems and methods creates, stores and uses extensive personal profile information for each user, thereby improving the reliability of determining the context of the speech and non-speech communications and presenting the expected results for a particular question or command.

主权项

1. A system for processing speech and non-speech communications, comprising:
a terminal device that receives the speech and the non-speech communications; a transcription module that transcribes the speech and the non-speech communications to create a speech-based textual message and a non-speech-based textual message; a merging module that merges the speech-based textual message and the non-speech-based textual message to generate a query; a search module that searches the query for text combinations; a comparison module that compares the text combinations to entries in a context description grammar; a plurality of domain agents that are associated with the context description grammar; a scoring module that provides relevance scores based on results from the comparison module; a domain agent selector that selects domain agents based on results from the scoring module; and a response generating module that communicates with the selected domain agents to obtain content that is gathered by the selected domain agents and that generates a response from the content, wherein the content is arranged in a selected order based on results from the scoring module.