Sketch recognition system

摘要

Handwriting interpretation tools, such as optical character recognition (OCR), have improved over the years such that OCR is a common tool in business for interpreting typed text and sometimes handwritten text. OCR does not apply well to non-text-only diagrams, such as chemical structure diagrams. A method according to an embodiment of the present invention of interpreting a human-drawn sketch includes determining a local metric indicating whether a candidate symbol belongs to a certain classification based on a set of features. The set of features includes, as a feature, scores generated from feature images of the candidate symbol. Also included is determining a joint metric of multiple candidate symbols based on their respective classifications and interpreting the sketch as a function of the local and joint metrics. Sketches can be chemical composition, biological composition, electrical schematic, mechanical, or any other science- or engineering-based diagrams for which human-drawn symbols have well-known counterparts.

主权项

1. A method of detecting corners in a stroke of a hand-drawn sketch, the method comprising:
by a processor, for each vertex in a set of vertices of a stroke, calculating a likelihood metric that the vertex is a corner; identifying a least likely vertex based on its likelihood metric; classifying the least likely vertex using segmentation parameters learned from training data; determining whether the least likely vertex is classified as a corner; if the least likely vertex is classified as a corner, the method further comprises returning all vertices remaining in the set of vertices as corners; and if the least likely vertex is not classified as a corner, the method further comprises removing the least likely vertex from the set of vertices and repeating the calculating, identifying, classifying, and determining.