AUGMENTED REALITY SIMULATOR

摘要

An augmented reality system (18) in which video imagery of a physical environment (20) is combined with video images output by a game engine by the use of a traveling matte (31) which identifies portions of the visible physical environment by techniques such as computer vision or chroma keying and replaces them with the video images output by the video game engine. The composited imagery of the physical environment (20) and the video game imagery is supplied to a trainee (24) through a headmounted display screen (30). Additionally, peripheral vision is preserved either by providing complete binocular display to the limits of peripheral vision, or by providing a visual path to the peripheral vision which is matched in luminance to higher resolution augmented reality images provided by the binocular displays (30). A software/hardware element comprised of a server control station (21) and a processor (36) onboard the trainee (24) performs the modeling, scenario generation, communications, tracking, and metric generation.