Method, graphical user interface, and computer program product for processing of a light field image

摘要

A method and a graphical user interface for processing of an object in light field data is provided. The method and graphical user interface may be used to remove an object or obstruction blocking another object or background of a captured scene. The method and graphical user interface may also be used for high precision edge detection in a light field image.

主权项

1. A method of processing a first light field image comprising light field data of a scene captured by a light field camera with known configuration, wherein the light field data comprises angular information of the captured scene, the method comprising:
rendering a first image from the light field data, corresponding to a first focal plane at which an object of the captured scene is in focus, selecting the object in the rendered image; applying a mask at least covering the pixels related to the edge of the selected object; deleting the pixels associated with the applied mask from the light field data, resulting in a first set of modified light field data; filling the pixels relating to the deleted pixels associated with the applied mask with data from the first set of modified light field data being relevant for the corresponding pixel position using the remaining angular information of the first set of modified light field data, resulting in a second set of modified light field data; rendering a further image from the second set of modified light field data, corresponding to the first focal plane; constructing a fourth image based on the pixel difference or a comparison between the first image and the further image; applying a further mask based on the pixels of the fourth image; extracting the pixels encompassed by the further mask in the light field data; and pasting the extracted pixels into a second light field image.