Estimation of object properties in 3D world

摘要

Objects within two-dimensional video data are modeled by three-dimensional models as a function of object type and motion through manually calibrating a two-dimensional image to the three spatial dimensions of a three-dimensional modeling cube. Calibrated three-dimensional locations of an object in motion in the two-dimensional image field of view of a video data input are determined and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the determined three-dimensional locations. The two-dimensional object image is replaced in the video data input with an object-type three-dimensional polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.

主权项

1. A computer-implemented method for modeling objects within two-dimensional video data by three-dimensional models, the method comprising executing on a processor the steps of:
in response to observing an image of an object in motion in a two-dimensional image field of view of a video data input from a camera at an initial time, determining an initial three-dimensional location of the observed two-dimensional object image; determining a second three-dimensional location of the observed two-dimensional object image at a second time that is subsequent to the initial time; determining a heading direction of the object as a function of a movement of the two-dimensional object image from the determined initial three-dimensional location to the determined second subsequent three-dimensional location; replacing the two-dimensional object image within the video data input with a selected three-dimensional polygonal model; orienting the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input in the determined heading direction; and scaling a bounding box of the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input from the camera to fit an image blob bounding box determined for the observed two-dimensional object image.