A method for matching an image and an apparatus thereof are provided to match the image stably in case and an apparatus therefore is big and to improve matching speed by matching the image in each pyramid level. A method for matching an image comprises the followings: an image acquisition part(510) obtaining a first image and a second image; an image transformer(520) converting each image into the image of a single channel; a pyramid generating unit(530) producing the image pyramid after a sub-sampling process; a direction calculation unit(540) calculating an optimized moving direction from two images; a motion vector calculation unit(550) renewing a motion vector; and an image updating unit(560) updating the first image based on the updated motion vector.
