FINE-GRAINED CATEGORIZATION

摘要

An image is passed through an image identifier to identify a coarse category for the image and a bounding box for a categorized object. A mask is used to identify the portion of the image that represents the object. Given the foreground mask, the convex hull of the mask is located and an aligned rectangle of minimum area that encloses the hull is fitted. The aligned bounding box is rotated and scaled, so that the foreground object is roughly moved to a standard orientation and size (referred to as calibrated). The calibrated image is used as an input to a fine-grained categorization module, which determines the fine category within the coarse category for the input image.

主权项

1. A system comprising:
a memory having instructions embodied thereon; and one or more processors configured by the instructions to perform operations comprising:
identifying a coarse category based on a first image;generating a bounding box that encompasses an item depicted in the first image;generating a second image by cropping the first image to the bounding box and rotating the cropped portion; andidentifying a fine category based on the second image, the fine category being a sub-category of the coarse category.