Multi-Modal Search

摘要

An identification method and process for objects from digitally captured images thereof that uses image characteristics to identify an object from a plurality of objects in a database. The image is broken down into parameters such as a Shape Comparison, Grayscale Comparison, Wavelet Comparison, and Color Cube Comparison with object data in one or more databases to identify the actual object of a digital image. The inventive subject matter also includes systems and methods of interacting with a virtual space, in which a mobile device is used to electronically capture image data of a real-world object, the image data is used to identify information related to the real-world object, and the information is used to interact with software to control at least one of: (a) an aspect of an electronic game; and (b) a second device local to the mobile device. Contemplated systems and methods can be used to gaming, in which the image data can be used to identify a name of the real-world object, to classify the real-world object, identify the real-world object as a player in the game, to identify the real-world object as a goal object or as having some other value in the game, to use the image data to identify the real-world object as a goal object in the game.

主权项

1. A method, comprising:
associating a real-world object with (a) an image of the real-world object in a database and (b) an information address; receiving, by a server and from a mobile device, a digital representation of a scene, the digital representation of the scene comprising location data; recognizing, by the server, the real-world object based on the digital representation of the scene; obtaining, by the mobile device, an item of information associated with the information address associated with the real-world object; and displaying, by the mobile device, graphical content as a function of the item of information.