METHODS FOR SUMMARIZING VIDEO THROUGH MOSAIC-BASED SHOT AND SCENE CLUSTERING

摘要

A method for summarizing a video comprising a plurality of consecutive frames is provided comprising the steps of dividing said plurality of consecutive frames into a plurality of shots (16). A mosaic representation for each shot is prepared (32). Color mosaic representations are prepared from color video. Each of the mosaic representations in the video may be compared using a novel alignment technique that incorporates a coarse matching step and a fine matching step (40-48). The mosaics are clustered into physical settings in which said frames were photographed. The efficient mosaic-based scene representation allows fast clustering of scenes into physical settings, as well as further comparison of physical settings across videos.