Generating decision-tree classifiers with oblique hyperplanes

摘要

A method and apparatus is disclosed for generating a decision tree classifier with oblique hyperplanes from a training set of records. The method iteratively comprises the steps of: initializing a set of vectors to the numeric attribute axes; creating a decision tree classifier using hyperplanes orthogonal to the set of vectors; checking if the iteration stopping criteria has been reached; computing a new set of vectors if the iteration proceeds; and choosing the best decision tree when the iteration is stopped. The vectors used are not restricted to the attribute axes and hence oblique hyperplanes are allowed to split nodes in the generated decision tree. The computation of the new vector set uses the decision tree produced in the latest iteration. The leaf nodes of this tree are considered pair-wise to compute the new vector set for use in the next iteration. The iterative process produces a set of decision trees from which the best one is chosen as the final result of the method.