Model Based Approach for On-Screen Item Selection and Disambiguation

摘要

A model-based approach for on-screen item selection and disambiguation is provided. An utterance may be received by a computing device in response to a display of a list of items for selection on a display screen. A disambiguation model may then be applied to the utterance. The disambiguation model may be utilized to determine whether the utterance is directed to at least one of the list of displayed items, extract referential features from the utterance and identify an item from the list corresponding to the utterance, based on the extracted referential features. The computing device may then perform an action which includes selecting the identified item associated with utterance.

主权项

1. A method comprising:
receiving, by a computing device, an utterance in response to displaying a plurality of items on a display; applying, by the computing device, a disambiguation model to the utterance for:
identifying whether the utterance is directed to at least one of the plurality of items on the display;extracting a plurality of referential features from the utterance; andidentifying an item among the plurality of items on the display corresponding to the utterance based on the plurality of referential features extracted from the utterance; and performing, by the computing device, an action associated with the utterance upon identifying the item among the plurality of items on the display corresponding to the utterance.