METHOD AND SYSTEM FOR RESOLVING CROSS-MODAL REFERENCES IN USER INPUTS

摘要

A method and a system for resolving cross-modal references in user inputs to a data processing system (100) are provided. The method includes generating (502) a set of multimodal interpretations (MMIs), based on the user inputs collected during a turn. The set of MMIs includes at least one reference, and each reference includes at least one reference variable. The method further includes generating (504) one or more sets of joint MMIs. Each set of joint MMIs includes MMIs of semantically compatible types. The method further includes generating (506) one or more sets of reference-resolved MMIs, by resolving the reference variables of the references contained in the sets of joint MMIs. The method further includes generating (508) an integrated MMI for each set of reference resolved MMIs. The generation of an integrated MMI is carried out by unifying the MMIs in a set of reference resolved MMIs.