APPARATUS AND METHOD FOR HIERARCHICAL OBJECT IDENTIFICATION USING A CAMERA ON GLASSES

摘要

Apparatuses and a method are provided for providing environmental information to a user, who may be visually impaired. In one implementation, a method is provided for receiving real time image data including an object within the user environment. The method includes identifying a hand-related trigger in the image data. Upon identifying the hand-related trigger, the method includes executing a first search in the image data in an attempt to identify at least one object from a first category of objects. After initiating the first search, the method includes executing a second search in the image data in an attempt to identify at least one object from a second category of objects that differs from the first. The method also includes outputting audible feedback to the user associated with information related to an object or objects identified in the image data.

主权项

1. An apparatus for providing environmental information to a visually-impaired user, the apparatus comprising:
a portable image sensor configured to be worn by the visually-impaired user and to capture real time image data from an environment of the visually-impaired user; and at least one portable processor device configured to:
receive the image data and identify a hand-related trigger in the image data;upon identifying the hand-related trigger, execute a first search in the image data to identify at least a first object from a first category of objects;after initiating the first search, execute a second search in at least one of the image data or results from the first search to identify at least a second object from a second category of objects, differing from the first category of objects; andcause audible feedback to be output to the visually-impaired user, wherein the audible feedback includes information related to at least one of the first and second objects identified in the image data.