System and method for manipulating user interface by 2D camera

摘要

A method for manipulating a user interface by a 2D camera within a vehicle includes: receiving a captured image of a passenger and a captured image of the reflection of the passenger on a reflector; extracting real and virtual images of the passenger from the captured images, and recognizing a gesture by a correlation between the real and virtual images; and selecting a vehicle equipment operation corresponding to the recognized gesture. Accordingly, the passenger is able to manipulate the steering wheel with one hand and keep their eyes forward while controlling multiple in-vehicle electronic devices with simple motions with the other hand, thereby improving passengers' convenience and driving safety.

主权项

1. A method for manipulating a user interface by a 2D camera in a vehicle including:
receiving a captured image of a passenger and a captured image of the reflection of the passenger on a reflector; extracting real and virtual images of the passenger from the captured images, and recognizing a gesture by correlation between the real and virtual images; and selecting a vehicle equipment operation corresponding to the recognized gesture, wherein the extracting of real and virtual images of the passenger from the captured images, and recognizing of a gesture by the correlation between the real and virtual images comprises:
extracting real and virtual images of a passenger's hand from the captured image of the passenger;extracting an image of the passenger's hand from the captured image of the passenger;generating trajectories of the real and virtual images; andrecognizing the gesture from the trajectories of the real and virtual images.