Using depth for recovering missing information in an image

摘要

An inpainting apparatus and method are described for infilling of blank areas from which an image object or area has been missing, removed, or moved from. Structure regions that reach the edge of the removed object area are identified and then prioritized as to fill order based on depth (distance) from the camera. Then these structure regions are filled in prioritized fill order, followed by remaining (homogeneous) areas to generate the inpainted image. The method may be performed on any desired computer-enabled electronic device, including cell phones, digital cameras, laptops, tablets, personal computers and other processor-equipped electronic devices.

主权项

1. An apparatus for inpainting missing, removed, or moved, objects or areas in an image frame, comprising:
(a) a computer processor; and (b) programming executable on said computer processor for performing steps comprising:
(i) identifying structure regions that reach an edge of a missing, removed, or moved area in an image frame;(ii) prioritizing a fill order for each structure region in response to its depth (distance) from the camera;wherein information about depth across the image frame is obtained prior to commencing inpainting, and is obtained in response to two picture blur matching;(iii) filling each said structure region in its prioritized fill order; and(iv) filling remaining areas of the missing, removed, or moved, object area to complete inpainting of the image frame.