SCALABLE SYSTEM AND METHOD FOR WEIGHTED SIMILARITY ESTIMATION IN MASSIVE DATASETS REVEALED IN A STREAMING FASHION

摘要

A method is used to data mine input vectors. A data source receives input vectors. A sketch feature generator converts the input vectors into corresponding sketch feature vectors, where each sketch feature vectors has a number of dimensions that is less than a number of dimensions of the corresponding input vector. A similarity comparator compares each sketch feature vectors against a set of parameters. A decision loop determines results of similarities based upon comparison of each sketch feature vectors against the set of parameters.

主权项

1. A method for data mining, comprising:
receiving, by a data source, a plurality of input vectors; converting, by a sketch feature generator, the plurality of input vectors into a corresponding plurality of sketch feature vectors, wherein each of the plurality of sketch feature vectors has a number of output dimensions that is less than a number of dimensions of a corresponding one of the input vectors; comparing, by a similarity comparator, each of the plurality of sketch feature vectors against a set of parameters; and generating, by a decision loop, results of similarities based upon a comparison of each of the plurality of sketch feature vectors against the set of parameters.