Actionable search results for street view visual queries

摘要

A server system receives a visual query and information about the current location of the querying device. The server system sends the query and location information to a visual query search system and receives one or more search results in accordance with the visual query and the location information. From the one or more search results, the server system identifies an entity in the visual query. The server system further identifies a client-side action corresponding to the identified entity and creates an actionable search result element configured to launch the client-side action. For example, if the identified entity were a restaurant the actionable search result elements could include buttons to initiate a telephone call, to read reviews, to map the address, or to make a reservation. If the actionable search result is selected, the client system launches the client-side action in an application distinct from the visual query client application.

主权项

1. A computer-implemented method of processing a visual query comprising:
at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors: receiving a visual query from a client system, the visual query comprising an image; analyzing the image to identify an entity associated with the visual query; receiving location information indicating a location of the client system, from the client system; obtaining search results for the visual query, wherein obtaining search results includes:
determining whether the image of the visual query matches an image in a corpus of images;in response to determining a matching image in the corpus of images, obtaining enhanced location information associated with the matching image, wherein the enhanced location information provides a greater specificity than the received location information from the client system; andobtaining search results in accordance with the visual query and the enhanced location information, wherein the search results include one or more search results associated with one or more second entities related to the first entity according to particular criteria; and sending at least (i) an image representing the first entity, (ii) information identifying the first entity, (iii) an image representing each of one or more second entities related to the first entity, and (iv) information identifying the one or more second entities, to the client system for concurrent display by the client system.