APPARATUS AND METHOD FOR TEXT SEGMENTATION BASED ON COHERENT UNITS

摘要

A text segmentation apparatus comprising means for analyzing an electronic text to determine likelihood of segmentation point for each of sentence end in the text based on a coherent unit, and means for segmenting said text into text segments based on the likelihood of segmentation point. The apparatus determines the similarity between the text parts contained in a pair of windows (Step 3) to be set up on the left and right sides of each sentence end position in the text so as to obtain similarity curves (Step 4). Then, the apparatus determines the likelihood of segmentation point (Step 5) for each sentence end point based on the obtained similarity curves, and segments the text at the point having the best likelihood of segmentation point (Step 6).