Lock-free indexing of documents

摘要

Methods and systems for serving documents are provided. Documents may be served to users, for example, in response to search query inputs. Documents may be individually received for serving to users. In order to serve documents, documents are typically indexed. To serve documents in a real-time environment, a data structure is configured to index documents that are received while simultaneously being queried for documents to serve to a user. Documents that have not yet completed the indexing process are not available for serving and, thus, are not queried. Additionally, the data structure includes a memory optimizer such that indexing does not waste memory of the data structure.

主权项

1. One or more computer storage hardware devices having one or more computer-useable instructions embodied thereon that, when executed perform a method, the method comprising:
receiving a first document at a data structure, wherein the data structure includes an index of one or more documents; receiving a search query at the data structure while the data structure is receiving the first document; determining, at the one or more computer storage devices, whether the first document is available for serving by identifying a cut-off point that indicates completion of individually indexing the first document, wherein if the first document has been completely indexed, the first document is available for serving, and if the first document has not been completely indexed, the first document is not available for serving, wherein the cut-off point is an indication that a mapping of content of the first document is complete; and upon determining the first document is available for serving, having identified completion of individually indexing of the first document, individually serving the first document while simultaneously indexing a second document prior to completion of a batching process that includes the first document and the second document.