PARSIMONIOUS HANDLING OF WORD INFLECTION VIA CATEGORICAL STEM + SUFFIX N-GRAM LANGUAGE MODELS

摘要

Systems and processes are disclosed for predicting words using a categorical stem and suffix word n-gram language model. A word prediction includes determining a stem probability using a stem language model. The word prediction also includes determining a suffix probability using suffix language model decoupled from the stem model, in view of one or more stem categories. The word prediction also includes determine a probability of the stem belonging to the stem category. A joint probability is determined based on the foregoing, and one or more word predictions having sufficient likelihood. In this way, the categorical stem and suffix language model constraints predicted suffixes to those that would be grammatically valid with predicted stems, thereby producing word predictions with grammatically valid stem and suffix combinations.

主权项

1. A method for predicting words, the method comprising:
at an electronic device:
receiving input from a user;determining, using an n-gram language model, a probability of a predicted word based on a previously-input word in the received input, wherein the predicted word comprises a stem and a suffix;determining, a probability of the suffix being grammatically valid for the stem;determining an integrated probability of the predicted word based on the probability of the predicted word and the probability of the suffix being grammatically valid for the stem; andproviding output of the predicted word, based on the integrated probability.