Method and system for automatically detecting multi-object anomalies utilizing joint sparse reconstruction model

摘要

Methods and systems for automatically detecting multi-object anomalies at a traffic intersection utilizing a joint sparse reconstruction model. A first input video sequence at a first traffic location can be received and at least one normal event involving P moving objects (where P is greater than or equal to 1) can be identified in an offline training phase. The normal event in the first input video sequence can be assigned to at least one normal event class and a training dictionary suitable for joint sparse reconstruction can be built in the offline training phase. A second input video sequence captured at a second traffic location similar to the first traffic location can be received and at least one event involving P moving objects can be identified in an online detection phase.

主权项

1. A method for detecting multi-object anomalies in transportation related video footage, said method comprising:
receiving in an offline training phase a first input video sequence at a first traffic location and identifying at least one normal event involving P moving objects, where P is greater than 1; assigning in said offline training phase said at least one normal event in said first input video sequence to at least one normal event class and building a training dictionary suitable for joint sparse reconstruction; receiving in an online detection phase a second input video sequence captured at a second traffic location similar to said first traffic location and identifying at least one event involving P moving objects; reconstructing in said online detection phase an approximation of said event within second input video sequence with respect to said training dictionary using a joint sparse reconstruction model; and determining in said online detection phase whether said event within second input video sequence is anomalous by evaluating an outlier rejection measure of said approximation and comparing said measure against a predetermined threshold, wherein said outlier rejection measure is given byJSCI⁡(S′)=K·maxi⁢λi⁡(S′)row,0/S′row,0-1K-1,⁢whereS′=[α1,1α2,1α1,2α2,2]and αi,j are coefficient sub-vectors corresponding to coefficient vectors αi, where i=1, 2, . . . , P represents concatenation of sub-dictionaries from all classes belonging to an i-th trajectory and j represents a given class, K represents a number of normal event classes, λi(S′) represents a characteristic function whose only non-zero entries are the rows in S′ that are associated with the i-th class, and row norm ∥ ∥row,0 represents the number of non-zero rows of a matrix.