System and method for transmission, processing, and rendering of stereoscopic and multi-view images

摘要

A digital image processing system takes color plus Z channel data as input, preprocesses, decimates, and codes the Z channel in-band as digital watermark data embedded within the color data prior to encoding and transmission. A second digital image processing system receives, decodes, and extracts the decimated Z channel data before applying statistical regularization to restore a full-resolution Z channel prior to depth-image-based rendering.

主权项

1. A computer implemented method comprising:
receiving a reduced bandwidth 3D image comprising a reduced bandwidth depth map and color data; applying, using a processor, a filter employing a statistical domain of the hue of the color data in a color space comprising a plurality of color channels to restore bandwidth of the reduced bandwidth depth map, the filter employing two radiosity weighting functions, the first radiosity weighting function provided by the reduced bandwidth depth map as a first domain, the second radiosity weighting function provided by a multi-channel color difference measure of the color data represented in the color space with at least one channel of the plurality of color channels incorporating a hue value of the color data and incorporating a gradient of the hue value of the color data as a second domain, the filter employing a spatial weighting function; and repeatedly subjecting the reduced bandwidth depth map to iterations of one-octave bicubic up-scaling followed by application of the filter until a first octave up-scaled depth map is produced, wherein repeatedly subjecting the reduced bandwidth depth map to iterations of one-octave bicubic up-scaling followed by application of the filter minimizes an error function comprising a difference between an edge gradient of the depth map and a color edge gradient of the color data to regularize output of the up-scaled depth map.