SYSTEM AND METHOD FOR PROVIDING AUGMENTED REALITY BASED DIRECTIONS BASED ON VERBAL AND GESTURAL CUES

摘要

A method and system for providing augmented reality based directions. The method and system include receiving a voice input based on verbal cues provided by one or more vehicle occupants in a vehicle. The method and system also include receiving a gesture input and a gaze input based on gestural cues and gaze cues provided by the one or more vehicle occupants in the vehicle. The method and system additionally include determining directives based on the voice input, the gesture input and the gaze input and associating the directives with the surrounding environment of the vehicle. Additionally, the method and system include generating augmented reality graphical elements based on the directives and the association of the directives with the surrounding environment of the vehicle. The method and system further include displaying the augmented reality graphical elements on a heads-up display system of the vehicle.

主权项

1. A method for providing augmented reality based directions, comprising:
receiving a voice input based on verbal cues provided by one or more vehicle occupants in a vehicle; receiving a gesture input and a gaze input based on gestural cues and gaze cues provided by the one or more vehicle occupants in the vehicle; determining directives based on the voice input, the gesture input and the gaze input; associating the directives with the surrounding environment of the vehicle; generating augmented reality graphical elements based on the directives and the association of the directives with the surrounding environment of the vehicle; and displaying the augmented reality graphical elements on a heads-up display system of the vehicle.