Optimizations for live event, real-time, 3D object tracking

摘要

Techniques for indexing multimedia data simultaneous with its capture to convert a real world event into an accessible database in real time are provided. The present invention introduces a new paradigm of converting a real world event in real time into a rich multimedia database by processing data from multiple cameras observing the event. Real time analysis of the camera data, coupled with domain knowledge, results in instant indexing of multimedia data at capture time itself. This yields the semantic information to answer complex queries about the content, and the ability to extract portions of data that correspond to complex actions performed in the real world.

主权项

1. A method for use in indexing, in a database, data associated with an event, where the event is conducted at a specific performance area over a specific performance time, the method comprising steps of:
processing detected data obtained in accordance with the event in real time, the detected data comprising tracking data of one or more event objects, where event objects are either objects or one or more people associated with the event, where the detected data are continuously received in real-time throughout the specific performance time and continuously comprise information pertaining to the entire specific performance area, where the tracking data are immediately generated from the detected data as the detected data are received and are stored in a tracking database with an index at least including event object and time, where time is directly related to the real-time of the event, and where the tracking data relate to the entire specific performance time and the entire specific performance area; capturing video in real-time from one or more cameras simultaneous with generating of the tracking data, where the video comprises video frames captured over time that are stored in a video database with an index at least including time, and where time is directly related to the real-time of the event; and providing in real-time and simultaneous to storing of the tracking and video data, a cross-link between the tracking database and the video database wherein video frames are then immediately retrieved by first accessing the tracking database.