Visual clothing retrieval

摘要

Techniques are provided for efficiently identifying relevant product images based on product items detected in a query image. In general, a query image may represent a digital image in any format that depicts a human body and one or more product items. For example, a query image may be an image for display on a webpage, an image captured by a user using a camera device, or an image that is part of a media content item, such as a frame from a video. Product items may be detected in a query image by segmenting the query image into a plurality of image segments and clustering one or more of the plurality image segments into one or more image segment clusters. The resulting image segments and image segment clusters may be used to search for visually similar product images.

主权项

1. A computer-implemented method comprising:
without segmenting an image generating a pose estimation, determining one or more regions of the image that are not likely to depict a product item; generating a masked image that masks the one or more regions; segmenting the masked image into a plurality of image segments based on shared characteristics of pixels that comprise the masked image, each image segment comprising a plurality of pixels that: form a continuous region of the masked image, and
share a characteristics, wherein two or more image segments of the plurality of image segments depict a same product; clustering the two or more image segments from the plurality of image segments into an image segment cluster; determining, for the image segment cluster, a particular product class of a plurality of product classes; retrieving, from an image database, one or more product images that are associated with the particular product class and that are selected based on a visual similarity between the one or more product images and the image segment cluster; wherein the method is performed by one or more computing devices.