EXEMPLAR-BASED NATURAL LANGUAGE PROCESSING

摘要

Systems and processes for exemplar-based natural language processing are provided. In one example process, a first text phrase can be received. It can be determined whether editing the first text phrase to match a second text phrase requires one or more of inserting, deleting, and substituting a word of the first text phrase. In response to determining that editing the first text phrase to match the second text phrase requires one or more of inserting, deleting, and substituting a word of the first text phrase, one or more of an insertion cost, a deletion cost, and a substitution cost can be determined. A semantic edit distance between the first text phrase and the second text phrase in a semantic space can be determined based on one or more of the insertion cost, the deletion cost, and the substitution cost.

主权项

1. A method for processing natural language comprising:
at an electronic device:
receiving a first text phrase;determining whether editing the first text phrase to match a second text phrase requires one or more of:
inserting a first word into the first text phrase, wherein the second text phrase includes the first word;deleting a second word from the first text phrase; wherein the first text phrase includes the second word; andsubstituting a third word of the first text phrase with a fourth word, wherein the second text phrase includes the fourth word;in response to determining that editing the first text phrase to match the second text phrase requires one or more of inserting the first word into the first text phrase, deleting the second word from the first text phrase, and substituting the third word of the first text phrase with the fourth word, determining one or more of:
an insertion cost associated with inserting the first word into the first text phrase;a deletion cost associated with deleting the second word from the first text phrase; anda substitution cost associated with substituting the third word of the first text phrase with the fourth word; anddetermining, based on the one or more of the insertion cost, the deletion cost, and the substitution cost, a semantic edit distance between the first text phrase and the second text phrase in a semantic space, wherein a degree of semantic similarity between the first text phrase and the second text phrase is based on the semantic edit distance.