A summary image browsing system and a method thereof are disclosed. The summary image browsing method according to the present invention comprises the steps of: tracking the orbit of object movement from an inputted video; extracting an object from the inputted video and create a series of object segments; and synthesizing the series of object segments in a background video along the orbit of object movement and create a summary video with thickness depending on the object emergence time for each object extracted from the inputted video.
