DISTRIBUTED APERTURE VISUAL INERTIA NAVIGATION

摘要

A system and method for visual inertial navigation for augmented reality are described. In some embodiments, at least one camera of a wearable device generates a plurality of video frames. At least one inertial measurement unit (IMU) sensors of the wearable device generates IMU data. Features in the plurality of video frames for each camera are tracked. The plurality of video frames for each camera are synchronized and aligned based on the IMU data. A dynamic state of the wearable device is computed based on the synchronized plurality of video frames with the IMU data for each camera. Augmented reality content is generated and positioned in a display of the wearable device based on the dynamic state of the wearable device.

主权项

1. A wearable device comprising:
at least one camera configured to capture an image and generate a plurality of video frames; at least one inertial measurement unit (IMU) sensor configured to generate IMU data of the wearable device; a feature tracking module configured to track at least one feature in the plurality of video frames for each camera; a synchronization module configured to synchronize and align the plurality of video frames for each camera based on the IMU data; a visual inertial navigation (VIN) module, executable by at least one hardware processor, configured to compute a dynamic state of the wearable device based on the synchronized plurality of video frames with the IMU data; and an augmented reality content module configured to generate and position augmented reality content in a display of the wearable device based on the dynamic state of the wearable device.