See-through augmented reality system

摘要

A see-through augmented reality system is disclosed. The system includes a head-wearable frame and a lens. The lens has at least one field-of-view (FOV). A sensor is configured to be coupled with respect to a head of a user. The sensor generates sensor data that changes responsive to movements of the head. A display apparatus is mapped to an interior surface of the lens. A controller is coupled to the sensor and to the display apparatus. The controller is configured to determine a current scene within the FOV based at least in part on the sensor data. The controller determines an out-the-window (OTW) scene portion of the current scene and a non-OTW scene portion of the current scene and generates OTW imagery that depicts the OTW scene portion. The controller causes the display apparatus to emit light in accordance with the OTW imagery toward the interior surface of the lens.

主权项

1. A system, comprising:
a head-wearable frame; a lens coupled to the head-wearable frame, the lens being transmissive and reflective and having at least one field-of-view (FOV) and an interior surface; a sensor configured to be coupled with respect to a head of a user and to generate sensor data that changes responsive to movements of the head; a display apparatus that is mapped to the interior surface of the lens; and a controller coupled to the sensor and the display apparatus, the controller being configured to:
determine a current scene of a real world environment within the FOV based at least in part on the sensor data, the real world environment comprising a window region and a non-window region;determine an out-the-window (OTW) scene portion comprising a portion of the window region that is in the current scene and a non-OTW scene portion comprising a portion of the non-window region that is in the current scene;generate OTW imagery configured to overlay the OTW scene portion without overlaying the non-OTW scene portion; andcause the display apparatus to emit light in accordance with the OTW imagery toward the interior surface of the lens, wherein the interior surface of the lens is configured to reflect the light toward an eye of the user to provide the OTW imagery in conjunction with the non-OTW scene portion.