Method for extracting low-rank descriptors from images and videos for querying, classification, and object detection

摘要

A method extracts a low-rank descriptor of a video acquired of a scene by first extracting a set of descriptors for each image in the video. The sets of descriptors for the video are aggregated to form a descriptor matrix. Iteratively, a low-rank descriptor matrix is determined from the descriptor matrix, as well as a selection matrix that associates each column in the descriptor matrix to a corresponding column in the low-rank descriptor matrix. The low-rank descriptor matrix is output upon convergence.

主权项

1. A method for querying a database of videos, comprising:
extracting a set of descriptors for each image in a video of a scene; aggregating the sets of descriptors for the video to form a descriptor matrix; determining a product of a low-rank descriptor matrix and a selection matrix using an orthogonal non-negative matrix factorization of the descriptor matrix, such that each column of the selection matrix has only one nonzero entry and associates a column in the descriptor matrix to a corresponding column in the low-rank descriptor matrix; wherein the factorization comprises:
determining a low-rank factor by a non-negative least squares minimization; anddetermining a selection matrix factor by minimizing a proximal point least squares problem and retaining a largest entry in every column of the selection matrix and setting all other entries to zero; and querying the database of videos including at least one video using the low-rank descriptor matrix to produce a search result, wherein the steps are performed in a processor.