Identifying textual terms in response to a visual query

摘要

A method, system, and computer readable storage medium is provided for identifying textual terms in response to a visual query is provided. A server system receives a visual query from a client system. The visual query is responded to as follows. A set of image feature values for the visual query is generated. The set of image feature values is mapped to a plurality of textual terms, including a weight for each of the textual terms in the plurality of textual terms. The textual terms are ranked in accordance with the weights of the textual terms. Then, in accordance with the ranking the textual terms, one or more of the ranked textual terms are sent to the client system.

主权项

1. A computer-implemented method comprising:
receiving a query image; obtaining a set of image features that are associated with the query image; obtaining a vector of image feature values for the set of image features; obtaining a set of query terms that correspond to the set of image features; for each query term of the set, obtaining a weight for the query term by applying the vector of image feature values to a respective image relevance vector for the query term, wherein each component of the image relevance vector indicates a relative importance of each corresponding component in the vector of image feature values in determining whether the query term is relevant; selecting a subset of the query terms based on the respective weight for each query term;and
providing, for output, one or more of the query terms of the subset of the query terms.