METHOD AND SYSTEM FOR IDENTIFYING BOOKS ON A BOOKSHELF

摘要

A method and system for identifying books located on a bookshelf. Photographs of the bookshelf are captured and processed to identify individual books. Processing involves segmenting the photograph into individual book spines and extracting and analyzing features of the book spines. Analysis may include database matching and/or optical character recognition.;Book spines for which a match is not found are human labeled, and the label information is added to the database. User feedback is also used to update the database.

主权项

1. A method for identifying books located on a bookshelf, the method comprising:
a. capturing one or more photographic images of the bookshelf; b. segmenting the photographic images into regions, each of the regions corresponding to a respective book spine; and c. analyzing at least one of the regions to identify a book corresponding thereto, wherein analyzing the at least one of the regions comprises:
extracting one or more visual features descriptive of the at least one of the regions, the one or more visual features including a feature indicative of machine-recognized text contained within the at least one of the regions;performing a matching operation based on the one or more visual features, the matching operation performed against stored data associating plural book identities with corresponding visual features;when the matching operation returns one of the book identities sufficiently closely matched with the one or more visual features, identifying the at least one of the regions as representing said one of the book identities;when the matching operation fails to return one of the book identities sufficiently closely matched with the one or more visual features, initiating a further analysis of the at least one of the regions to identify the book corresponding thereto; andwhen the further analysis returns a further book identity sufficiently closely matched with the one or more visual features, identifying the at least one of the regions as representing the further book identity.