DETERMINING SEGMENTS FOR DOCUMENTS

摘要

A document is received for segmentation. The document includes multiple atomic textual units in a sequence. These units may correspond to sentences, phrases, paragraphs, concept phrases, chapters, etc. A distance function is selected that determines a distance between one set of atomic textual units and another set of atomic textual units. The distance between the sets is large for sets that are dissimilar, and small for sets that are similar. The distance function is applied to the atomic textual units to separate each of the atomic textual units into multiple segments, while maintaining the sequence of the atomic textual units.

主权项

1. A method comprising:
receiving a document comprising a plurality of atomic textual units, by a computing device; receiving a distance function by the computing device, wherein the distance function takes as an input a first sequential subset of the plurality of atomic textual units and a second sequential subset of the plurality of atomic textual units and outputs a distance between the first and the second sequential subsets; and determining a plurality of segments of the document using the distance function by the computing device, wherein each segment includes a sequential subset of the plurality of atomic textual units.