Context-based detection and classification of actions

摘要

Actions or activities occurring within an environment may be detected, recognized and classified based on the presence or absence of objects within the environment, which may be recognized within imaging data. The states or changes in states of the objects may be tracked within the imaging data and associated with one or more actions or activities with various probabilities. By tracking the motion of objects, rather than the motion of humans or other actors, the detection and classification of actions or activities may be performed more quickly and efficiently, and may be used to determine the timing associated with one or more steps of such activities, as well as whether each of the steps of an activity has been satisfactorily performed and in an appropriate order.

主权项

1. A monitoring system comprising:
a plurality of imaging devices; and a computing device in communication with at least one of the plurality of imaging devices, wherein the computing device is configured to implement one or more services, and wherein the one or more services are configured to:
cause a first set of imaging data to be captured by at least one of the plurality of imaging devices;provide at least a portion of the first set of imaging data as an input to at least one first classifier, wherein the at least one first classifier is configured to recognize at least one object within the first set of imaging data;recognize the at least one object within the imaging data based at least in part on an output from the at least one first classifier;recognize a state of the at least one object based at least in part on the output from the at least one first classifier;provide information regarding the at least one object and the state of the at least one object as an input to at least one second classifier, wherein the at least one second classifier is configured to associate at least one of the object or the state of the at least one object with one of a predetermined number of actions or activities;identify at least one action or activity based at least in part on an output from the at least one second classifier; andstore information regarding the action or the activity in at least one data store.