Video refocusing

摘要

The present invention operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.

主权项

1. A light field video acquisition device comprising:
optics; a photosensor array, configured to acquire first light field video data, and further configured to acquire second light field video data after acquisition of the first light field video data; a microlens array, disposed between the optics and the photosensor array so that light rays are directed onto the photosensor array via the optics and the microlens array; first memory, configured to store up to a predetermined amount of:
first refocusable video data which is representative of the first light field video data;second refocusable video data which is representative of the second light field video data;first summary data derived from the first light field video data; andsecond summary data derived from the second light field video data;wherein the first and second refocusable light field video data each comprise a representation having at least four dimensions and comprising at least an indication of a direction of travel of light;and wherein the second summary data is derived after acquisition of the first light field video data; second memory, configured to store video data; and processing circuitry, coupled to the first memory and to the second memory, configured to:
(i) determine a first virtual focus parameter using the second summary data;(ii) generate first video data using the first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from the optical focus depth of the acquired first light field video data; and(iii) cause an output device to output the first video data.