Augmented auditory perception for the visually impaired

摘要

A person is provided with the ability to auditorily determine the spatial geometry of his current physical environment. A spatial map of the current physical environment of the person is generated. The spatial map is then used to generate a spatialized audio representation of the environment. The spatialized audio representation is then output to a stereo listening device which is being worn by the person.

主权项

1. A computer-implemented process for providing a person with the ability to auditorily determine the spatial geometry of his current physical environment, comprising:
using a computer to perform the following process actions: generating a depth map of the current physical environment of the person; analyzing the depth map to identify objects and passageways therein; analyzing the depth map to determine the current spatial coordinates, from the perspective of an environment sensing device being held by the person, of each of the identified objects and passageways; using a first spatial orientation sensor within the sensing device to determine the current spatial orientation of the sensing device; using a second spatial orientation sensor within a stereo listening device being worn on the head of the person to determine the current spatial orientation of the head of the person, wherein the second spatial orientation sensor is located at a distance from the first spatial orientation sensor; comparing the current spatial orientation of the sensing device to the current spatial orientation of the head of the person to determine a relative current pose between the sensing device and head; determining the current distance between the sensing device and head; using said current pose and current distance to transform the current spatial coordinates of each of the identified objects and passageways to be from the perspective of the head of the person; using the depth map to generate a spatialized audio representation of the current physical environment; and outputting said spatialized audio representation to the stereo listening device.