System, method, and computer program product for joint color and depth encoding

摘要

A system and method are provided for performing joint color and depth encoding. Color data and depth data for an image is received. Based on the color data, confidence values are computed for the depth data and the depth data is encoded based on the confidence values to represent a correlated portion of the depth data and a decorrelated portion of the depth data. In one embodiment, the depth data comprises per-pixel vergence angles.

主权项

1. A method, comprising:
receiving color data for an image; receiving depth data for the image; computing confidence values for the depth data based on the color data; computing, based on the confidence values, complementary confidence values corresponding to a decorrelated portion of the depth data; determining a representative decorrelated depth value corresponding to the decorrelated portion of the depth data; and computing a residual value as a difference between the representative decorrelated depth value and a sampled depth value for a block of pixels within the image; and encoding the depth data based on the confidence values to represent a correlated portion of the depth data and the decorrelated portion of the depth data.