Computation of a recongnizability score (quality predictor) for image retrieval

摘要

A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR system also includes a quality predictor as a plug-in installed on the mobile device to filter images before they are included as part of a retrieval request or as part of the MMR matching unit. The quality predictor comprises an input for receiving recognition algorithm information, a vector calculator, a score generator and a scoring module. The quality predictor receives as inputs an image query, context information and device parameters, and generates an outputs a recognizability score. The present invention also includes a method for generating robustness features.

主权项

1. An apparatus for generating a recognizability score, the apparatus comprising:
a vector calculator for determining a plurality of quality feature vectors from an input image to measure distortion of the input image including blurriness and coding artifacts and to determine whether the input image is stable to the distortion by applying different levels of the distortion to the input image, measuring distances between the input image and the distorted images and determining whether a combination of the distances is small, the vector calculator adapted for communication to receive the input image; a score generator for generating a recognition score for each of the quality feature vectors, the score generator adapted to receive the quality feature vectors from the vector calculator; and a scoring module for determining recognition results, generating the recognizability score from the recognition scores, generating a confidence score for each recognition result that reflects a confidence in the recognition result based on the recognizability score and merging and sorting the recognition results to produce one or more top results using the confidence scores, the scoring module adapted to communicate with the score generator to receive the recognition scores.