Image processing apparatus and method with setting of prohibited region and generation of computer graphics data based on prohibited region and first or second position/orientation

摘要

This invention has as its object to provide a high-quality composite image of a real image and virtual image to a viewer or the like. To achieve this object, the position/posture of photographing means for photographing a performer or the like is measured, the position/posture of an HMD, which the performer or the like wears, and which allows the viewer to see through the external world, is measured, a CG at the viewpoint of the photographing means and image data photographed by the photographing means are aligned and composited on the basis of the measurement result of the position/posture of the photographing means, CG at the viewpoint of the HMD and image data photographed by a camera built in the HMD are aligned and composited on the basis of the measurement result of the position/posture of the HMD, and image data is displayed on the HMD.