Simulated video with extra viewpoints and enhanced resolution for traffic cameras

摘要

Simulated high resolution, multi-view video based on video input from low resolution, single-direction cameras is provided. Video received from traffic cameras, security cameras, monitoring cameras, and comparable ones is fused with patches from a database of pre-captured images and/or temporally shifted video to create higher quality video, as well as multiple viewpoints for the same camera.

主权项

1. A method to be executed at least in part in a computing device for generating an enhanced simulated video from a camera feed, the method comprising:
setting up a plurality of cameras in different directions at a location for a predetermined period of time to capture stored images of vehicles at a plurality of angles that are indexed; receiving an original video input from a single-direction camera; generating a stream of vehicle video patches; matching vehicles in the vehicle video patches to corresponding the stored images of vehicles employing a moving window with normalized cross-correlation, wherein the stored images of the vehicles are based on at least one from a set of: a make, a model, and a color of each vehicle; retrieving images of a different angle corresponding to the stored images of the vehicles; fusing the retrieved images into a simulated video displaying the vehicles moving in another direction; generating the simulated video at a different frame rate than a frame rate of the original video input to reduce a blurriness and a dullness of the original video input; and rendering the simulated video.