Probabilistic registration of interactions, actions or activities from multiple views

摘要

Images of an environment that are captured from two or more imaging devices may be captured and evaluated in order to identify a state of the environment, or an interaction that placed the environment in the state. The content of the images may be analyzed in order to recognize observed information or data expressed therein. The information or data may be associated with a given state according to one or more observation functions, and the state may be used to identify an action according to one or more transition functions. The observation function uses conditional probabilities to transfer the probability of making an observation by one imaging device to the observation made by the other imaging device. The observation functions and the transition functions may be derived based on historical training data including clips that are labeled to identify states or interactions expressed therein.

主权项

1. A monitoring system comprising:
a plurality of imaging devices; and a computing device in communication with a first imaging device and a second imaging device, wherein the computing device is configured to implement one or more services, and wherein the one or more services are configured to:
receive a first set of imaging data captured using the first imaging device having a first orientation with respect to an environment at a first time;receive a second set of imaging data captured using the second imaging device having a second orientation with respect to the environment at the first time;receive a third set of imaging data captured using the first imaging device having the first orientation with respect to the environment at a second time;receive a fourth set of imaging data captured using the second imaging device having the second orientation with respect to the environment at the second time;identify a first probability that at least one of the first imaging device or the second imaging device captured the environment in a first state at the first time based at least in part on the first set of imaging data and the second set of imaging data;determine, according to an observation probability function, a second probability that at least one of the first imaging device or the second imaging device captured the environment in a second state at the second time based at least in part on the third set of imaging data and the fourth set of imaging data; andselect, according to a transition probability function, an interaction associated with a change from the first state to the second state based at least in part on the first probability and the second probability.