Intelligent multi modal communications apparatus utilizing predetermined rules to choose optimal combinations of input and output formats

摘要

A multimodal interaction apparatus for performing a predetermined process depending upon interaction with a user to output a result of the process. The multimodal interaction apparatus comprises an input section for interpreting information input from at least one input means selected from plural input means in accordance with input media allocation and generating correspondence information in accordance with the interpretation, a problem solving section for subjecting the correspondence information to a predetermined process and outputting a result of the process and an output section for outputting the result of the process from at least one output means selected from plural output means in accordance with output media allocation.