System and Method for Gesture-Based Point of Interest Search

摘要

A user, such as the driver of a vehicle, to retrieve information related to a point of interest (POI) near the vehicle by pointing at the POI or performing some other gesture to identify the POI. Gesture recognition is performed on the gesture to generate a target region that includes the POI that the user identified. After generating the target region, information about the POI can be retrieved by querying a server-based POI service with the target region or by searching in a micromap that is stored locally. The retrieved POI information can then be provided to the user via a display and/or speaker in the vehicle. This process beneficially allows a user to rapidly identify and retrieve information about a POI near the vehicle without having to navigate a user interface by manipulating a touchscreen or physical buttons.

主权项

1. A vehicle-based computer-implemented method for retrieving information associated with a point of interest (POI), the method comprising:
receiving, at a computing system, a data signal representing an identifying gesture performed by a user inside a vehicle, the identifying gesture oriented in a direction and identifying an object exterior to the vehicle; performing gesture recognition on the data signal to determine a direction vector representing the direction of the identifying gesture; accessing location data identifying a current location and orientation of the vehicle; analyzing the direction vector and the location data to generate a target region corresponding to the object identified by the identifying gesture; retrieving information associated with one or more points of interest located in the target region; and providing the retrieved information to the user, the retrieved information including information associated with the object identified by the identifying gesture.