| 摘要 |
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system includes an MMR user, a MMR computer, a user printer that produces a printed document, a networked media server, an office portal, a service provider server, an electronic display that is electrically connected to a set-top box, a document scanner, a network, a capture device, a cellular infrastructure, wireless fidelity (Wi-Fi) technology, Bluetooth® technology, infrared (IR) technology, wired technology, and a geo location mechanism. The MMR system of the present invention provides mechanisms for forming a mixed media document that includes media of at least two types, such as printed paper as a first medium and a digital photograph, digital movie, digital audio file, or web link as a second medium. Furthermore, the MMR system of the present invention facilitates business methods that take advantage of the combination of a portable electronic device, such as a cellular camera phone, and a paper document. |
| 主权项 |
1. A system comprising:
one or more mixed media processors configured to:
receive an image patch of at least a first portion of a media; andcompare features of the first image patch to a previously generated mixed media document data structure to associate the media with the mixed media document data structure; a mixed media document data structure comprising:
a representation of the media comprising a matchable portion corresponding to a first location within the media, the matchable portion for matching to the received image patch, and the matchable portion including a geometric relationship between a first portion of a first line of text and a second portion of a second line of text, wherein the geometric relationship is determined based on at least one from the group of specifying x-y locations of characters of the media, specifying x-y locations of words of the media, specifying x-y locations of an image or a portion of an image in the media, performing an optical character recognition operation and specifying x-y locations of at least one of characters and words, andperforming feature extraction and specifying x-y locations of at least one of features, characters, and words; andan index correlating the matchable portion of the representation with an identifier for information associated with the media; and a media storage communicatively coupled to the one or more mixed media processors that stores the mixed media document data structure. |
