System and method for contexually interpreting image sequences

摘要

A system and method for contextually interpreting image sequences are provided. The method comprises receiving video from one or more video sources, and generating one or more questions associated with one or more portions of the video based on at least one user-defined objective. The method further comprises sending the one or more portions of the video and the one or more questions to one or more assistants, receiving one or more answers to the one or more questions from the one or more assistants, and determining a contextual interpretation of the video based on the one or more answers and the video.

主权项

1. A method, comprising:
receiving, by a computer, video from one or more video sources; generating, by the computer, one or more questions associated with one or more portions of the video; sending, by the computer, the one or more portions of the video and the one or more questions to one or more assistants; receiving, by the computer, one or more answers to the one or more questions from the one or more assistants; and determining, by the computer, a contextual interpretation of the video based on the one or more answers and the video, wherein: the video comprises recorded image sequences recorded by a surveillance system; the one or more assistants are one or more persons; and the determining the contextual interpretation by the computer uses interpretations of both the one or more persons and the computer; further comprising identifying, by the computer, the one or more portions of the video for which the determining the contextual interpretation requires assistance based on at least one user-defined objective for the contextual interpretation; wherein the at least one user-defined objective comprises identifying, based on one or more criterion defined by the user, one of: (i) one or more items possessed by a person in the video, and (ii) a person in the video having difficulty breathing.