Computationally efficient scene classification

摘要

The disclosure describes novel technology for inferring scenes from images. In one example, the technology includes a system that can determine partition regions from one or more factors that are independent of the image data, for an image depicting a scene; receive image data including pixels forming the image; classify pixels of the image into one or more pixel types based on one or more pixel-level features; determine, for each partition region, a set of pixel characteristic data describing a portion of the image included in the partition region based on the one or more pixel types of pixels in the partition region; and classify a scene of the image based on the set of pixel characteristic data of each of the partition regions.

主权项

1. A computer-implemented method comprising:
determining a partition layout of partition regions that corresponds to a scene depicted by an image captured by a camera of a moving platform; receiving one or more contextual attributes describing a motion of the moving platform; dynamically reshaping the partition layout of the partition regions by adjusting a location of a central point based at least on the motion of the moving platform; classifying pixels forming the image into one or more pixel types based on one or more pixel-level features; determining, for each partition region, a set of pixel characteristic data describing a portion of the image included in the partition region based on the one or more pixel types of pixels in the partition region; and classifying the scene of the image based on the set of pixel characteristic data of each of the partition regions.