GENERATING STORY GRAPHS WITH LARGE COLLECTIONS OF ONLINE IMAGES

摘要

Embodiments presented herein describe techniques for generating a story graph using a collection of digital media, such as images and video. The story graph presents a structure for activities, events, and locales commonly occurring in sets of photographs taken by different individuals across a given location (e.g., a theme park, tourist attraction, convention, etc.). To build a story graph, streams from sets of digital media are generated. Each stream corresponds to media (e.g., images or video) taken in sequence at the location by an individual (or related group of individuals) over a period of time. For each stream, features from each media are extracted relative to the stream. Clusters of media are generated and are connected by directed edges. The connections indicate a path observed to have occurred in the streams from one cluster to another cluster.

主权项

1. A method for generating a representation of activities occurring within a given location having one or more landmarks based on a collection of digital media, the method comprising:
generating, via a processor, a plurality of streams from the collection of media, each stream corresponding to an ordered sequence of media captured by an individual over a given period of time; for each stream, extracting features from one or more of the media in the stream; generating, from the plurality of streams, one or more clusters of the collection of the media based on the extracted features, wherein each cluster indicates a landmark depicted in the media of the cluster; and connecting clusters with directed edges, wherein each directed edge indicates a path from a first landmark to a second landmark based on the ordered sequence of images from each stream.