Depth constrained superpixel-based depth map refinement

摘要

A method of forming a refined depth map DR of an image I using a binary depth map DI of the image, said method comprising segmenting (315) the image into a superpixel image SREP, defining (330) a foreground and a background in the superpixel image SREP, to form a superpixel depth map DS, intersecting (450) the respective foreground and the background of the superpixel depth map DS with the binary depth map DI determined independently of the superpixel image SREP, to define a trimap T consisting of a foreground region, a background region and an unknown region, and forming the refined binary depth map DR of the image from the trimap T by reclassifying (355, 365) the pixels in the unknown region as either foreground or background based on a comparison (510) of the pixel values in the unknown region with pixel values in at least one of the other trimap regions.

主权项

1. A method of forming a refined depth map from a high-resolution image of a scene and a low-resolution depth map of said image, said method comprising the steps of:
segmenting the high-resolution image into a plurality of superpixels, being connected sets of pixels of the high-resolution image, to form a superpixel segmented image; determining at least one depth measure associated with the superpixels in the superpixel segmented image to thereby form a superpixel depth map having a foreground region and a background region; intersecting the foreground region and the background region of the superpixel depth map with the respective foreground region and the background region of the low-resolution binary depth map to define a trimap having a foreground region, a background region and an unknown region; and reclassifying pixels in the unknown region of the trimap as either foreground or background pixels of the trimap based on a comparison of pixel values in the unknown region of the trimap with pixel values in at least one of the foreground region of the trimap and the background region of the trimap, thereby forming said refined depth map.