Sensor fusion interface for multiple sensor input

摘要

The subject disclosure is directed towards a sensor fusion interface that enables interaction between one or more entities of a physical environment and a computerized device component. A plurality of sensor modules generate multiple sensor input data associated with one or more entities in an environment and store such data in a shared library in accordance with a uniform and common schema. The multiple sensor input data is refined until a certain level of accuracy is achieved. Using the sensor fusion interface, entity state data is extracted from the shared library and exposed to the computerized device component.

主权项

1. In a computing environment, a method performed at least in part on at least one processor, comprising:
processing requests received via a sensor fusion interface to enable interaction between one or more entities and an computerized device component, including:
accessing a shared library that is coupled to a plurality of sensor modules corresponding to at least two input modalities for the one or more entities, the shared library comprising a schematized version of multiple sensor input data to represent a cross-sensor synthesis;transforming the schematized version of the multiple sensor input data into entity state data; andperforming at least one of communicating an event corresponding to a change in entity pose, generating control data corresponding to different points-in-time, or correlating a portion of the entity state data associated with an entity and another portion of the entity state data associated with another entity to determine entity interactions.