PURPOSE: A 3D image processing apparatus and a method thereof are provided to a real 3D video by using a color-depth camera. CONSTITUTION: A receiving unit(110) receives photographed color images and a plurality of depth images. An estimation unit(120) estimates location and direction of virtual cameras using 3D feature points. A fusion unit(130) fuses the 3D feature points into one reference coordinate system through the estimated virtual camera location and direction. A texture mapping unit(140) projects the 3D feature points which are expressed in one reference coordinate into a plurality of color images.