MULTI MODAL APPROACH TO SEARCH QUERY INPUT

摘要

Search queries containing multiple modes of query input are used to identify responsive results. The search queries can be composed of combinations of keyword or text input image input video input audio input or other modes of input. The multiple modes of query input can be present in an initial search request or an initial request containing a single type of query input can be supplemented with a second type of input. In addition to providing responsive results in some embodiments additional query refinements or suggestions can be made based on the content of the query or the initially responsive results.