Depth and video co-processing

摘要

Co-processing of a video frame (32) and its associated depth map (34) suitable for free viewpoint television involves detecting respective edges (70, 71, 80, 81) in the video frame (32) and the depth map (34). The edges (70, 71, 80, 81) are aligned and used to identify any pixels (90-92) in the depth map (34) or the video frame (32) having incorrect depth values or color values based on the positions of the pixels in the depth map (34)or the video frame (32) relative an edge (80) in 5 the depth map (34) and a corresponding, aligned edge (70) in the video frame (32). The depth values or color values of the identified pixels (90-92) can then be corrected in order to improve the accuracy of the depth map (32) or video frame (34).

主权项

1. A method of co-processing a video frame comprising multiple pixels having respective color values as pixel property values of a camera view and a depth map comprising multiple pixels having respective depth values as pixel property values of said camera view, said method comprising:
detecting at least one edge in said video frame based on respective color values of at least a portion of said multiple pixels in said video frame; detecting at least one edge in said depth map based on respective depth values of at least a portion of said multiple pixels in said depth map; aligning said at least one edge in said video frame and said at least one edge in said depth map; and identifying at least one pixel in said video frame or said depth map having an incorrect pixel property value based on a position of said at least one pixel in said video frame or said depth map relative to an edge in said video frame or said depth map and the corresponding aligned edge in the other of said video frame and said depth map.