VIDEO ANALYSIS TECHNIQUES FOR IMPROVED EDITING, NAVIGATION, AND SUMMARIZATION

摘要

Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

主权项

1. A system, comprising:
one or more processors configured to implement a video analyzer comprising: a prioritization component configured to receive video data and provide prioritization information for a plurality of segments of the video data, wherein the video data comprises a plurality of frames and corresponding metadata, wherein the prioritization component comprises:
a metadata analyzer configured to analyze the metadata from the video data and determine metadata-based prioritization data for one or more portions of the video data based at least in part on analysis of the metadata;a content analyzer configured to analyze content of the plurality of frames and determine content-based prioritization data for one or more portions of the video data based at least in part on analysis of the content of the plurality of frames; anda video prioritization generator configured to generate the prioritization information based at least in part on the metadata-based data and the content-based data, wherein the prioritization information indicates a priority for the plurality of segments of the video data.