Methods and Apparatus for Autonomous Robotic Control

摘要

Sensory processing of visual, auditory, and other sensor information (e.g., visual imagery, LIDAR, RADAR) is conventionally based on “stovepiped,” or isolated processing, with little interactions between modules. Biological systems, on the other hand, fuse multi-sensory information to identify nearby objects of interest more quickly, more efficiently, and with higher signal-to-noise ratios. Similarly, examples of the OpenSense technology disclosed herein use neurally inspired processing to identify and locate objects in a robot's environment. This enables the robot to navigate its environment more quickly and with lower computational and power requirements.

主权项

1. A system for automatically locating and identifying an object in an environment, the system comprising:
at least one sensor to acquire sensor data representing of at least a portion of the object; a spatial attention module, operably coupled to the at least one sensor, to produce a foveated representation of the object based at least in part on the sensor data, to track a position of the object within the environment based at least in part on the foveated representation, and to select another portion of the environment to be sensed by the at least one sensor based at least in part on the foveated representation of the object; and a semantics module, operably coupled to the spatial attention module, to determine an identity of the object based at least in part on the foveated representation of the object.