MOBILE VISUAL SEARCH USING DEEP VARIANT CODING

摘要

An approach for performing mobile visual search uses deep variant coding of images to reduce the amount of data transmitted from mobile devices to a search server and to provide more efficient indexing and searching on the search server. The amount of data used to represent an image varies depending upon the content of the image and is less than conventional fixed bit length hashing approaches. Denser regions of a feature space are represented by more encoding bits and sparser regions of the feature space are represented by fewer encoding bits, so that the overall number of encoding bits for an image feature is reduced. The approach generally involves determining a set of hash functions that provide deep hashing with more evenly-distributed hash buckets. One or more additional hash functions may be selectively generated for particular hash buckets that contain more than a specified number of images.

主权项

1. A search server comprising:
one or more processors; one or more memories communicatively coupled to the one or more processors; and a search process configured to:
receive from a mobile device over one or more communications networks, a search query that includes a set of two or more hash bits that represent results of processing image data for an image with a plurality of hash functions, wherein a number of hash bits in the set of two or more hash bits varies depending upon the content of the image data for the image,identify, based upon the set of two or more hash bits that represent results of processing image data for an image with a plurality of hash functions included in the search query, a particular hash bucket from a plurality of hash buckets,identify one or more other images that belong to the particular hash bucket from the plurality of hash buckets, andcause to be transmitted, to the mobile device over the one or more communications networks, search results that identify the one or more other images that belong to the particular hash bucket from the plurality of hash buckets.