Image processing system, image processing apparatus, and image processing method for combining CG image with captured image

摘要

An image processing system includes an imaging unit for imaging an outside world to generate a captured image, a position and orientation estimation unit for estimating a position and orientation of the imaging unit, a feature point estimation unit for estimating a position of a feature point in the captured image, a clipping unit for clipping an image for combining, and clipping an image for feature detection, a measurement unit for detecting a feature point from the image for feature detection, and measuring a position and orientation of the imaging unit, a generation unit for generating a CG image based on the position and orientation measured by the measurement unit, a combining unit for combining the image clipped by the clipping unit with the CG image, and a display control unit for displaying the image combined by the combining unit on a display unit.

主权项

1. An image processing system comprising:
an imaging unit configured to image an outside world to generate a captured image; a position and orientation estimation unit configured to estimate a position and orientation of the imaging unit; a feature point estimation unit configured to estimate a position of a feature point in the captured image based on the position and orientation of the imaging unit estimated by the position and orientation estimation unit; a clipping unit configured to clip an image for combining, and clip an image for feature detection based on the position of the feature point estimated by the feature point estimation unit, the image for combining and the image for feature detection being clipped from the captured image generated by the imaging unit; a measurement unit configured to detect a feature point from the image for feature detection clipped by the clipping unit, and measure a position and orientation of the imaging unit based on the detected feature point; a generation unit configured to generate a computer graphics (CG) image based on the position and orientation measured by the measurement unit; a combining unit configured to combine the image for combining clipped by the clipping unit with the CG image generated by the generation unit; and a display control unit configured to display the image combined by the combining unit on a display unit.