Probabilistic registration of interactions, actions or activities from multiple views

摘要

Images of an environment that are captured from two or more imaging devices may be captured and evaluated in order to identify a state of the environment, or an interaction that placed the environment in the state. The content of the images may be analyzed in order to recognize observed information or data expressed therein. The information or data may be associated with a given state according to one or more observation functions, and the state may be used to identify an action according to one or more transition functions. The observation function uses conditional probabilities to transfer the probability of making an observation by one imaging device to the observation made by the other imaging device. The observation functions and the transition functions may be derived based on historical training data including clips that are labeled to identify states or interactions expressed therein.

主权项

1. A system for monitoring an environment comprising:
a plurality of digital cameras, wherein the plurality of digital cameras includes a first digital camera having a first orientation with respect to the environment and a second digital camera having a second orientation with respect to the environment; and a computing device having at least one computer processor and at least one memory, wherein the computing device is in communication with at least the first digital camera and the second digital camera, wherein the computing device is configured to at least:
cause the first digital camera to capture a first digital image at a first time;cause the second digital camera to capture a second digital image at the first time;determine, according to a first function, a first probability that the environment is in a first state at the first time based at least in part on the first digital image and the second digital image;cause the first digital camera to capture a third digital image at a second time;cause the second digital camera to capture a fourth digital image at the second time;determine, according to the first function, a second probability that the environment is in a second state at the second time based at least in part on the third digital image and the fourth digital image; andselect, according to a second function, an interaction associated with a change from the first state to the second state based at least in part on the first probability and the second probability.