A system and method for detecting and isolating a shadow of buildings or structures of interest within an input image. The building or structure of interest is localized by the system using region based geometric active contour modeling, and the present approach is able to overcome complexity of pattern and structure by a sequence of global and local processing to remove image data from clutter.