Image retrieval using discriminative visual features

摘要

Image search results are obtained by providing weights to visual features to emphasize features corresponding to objects of interest while simultaneously deemphasizing irrelevant or inconsistent features that lead to poor search results. In order to minimize the impact of visual features that are unreliable or irrelevant with respect to the objects of interest in the image, context-dependent weights are provided to detect visual features such that those visual features pertaining to the objects of interest are more heavily weighted than those visual features that pertain to irrelevant or unreliable portions of the image. Visual features may be weighted for images in a searchable database. Training data may be obtained and used in weighting visual features in a query image and, alternatively, in searchable database images.

主权项

1. A method of weighting visual features in an image, the method comprising:
detecting, by a computing device, a plurality of visual features for the image; determining, by the computing device, a plurality of descriptors based on the plurality of visual features; determining, by the computing device, a visual word corresponding to each of the plurality of descriptors by quantizing each descriptor using a collection of known visual words; determining, by the computing device, a weight for each of the plurality of descriptors, wherein determining a weight for a descriptor comprises calculating the weight based on a vector associated with the visual word corresponding to the descriptor and a concatenated vector of a local context and a global context and based on a difference between the vector associated with the visual word corresponding to the descriptor and vectors associated with visual words corresponding to one or more descriptors of the plurality of descriptors that are neighbors of the descriptor; and adding the image to a database of images by the computing device, wherein the database of images is indexed based on the weighted descriptors.