Multi-User Search System Using Tokens

摘要

A multi-user search system with methodology for instant indexing. In one embodiment, for example, a system for instant indexing includes a token store storing sets of tokens for current versions of documents. The system further includes a tokenizer server configured to tokenize new versions of the documents and to generate sets of tokens for the new versions of the documents, an instant indexer configured to determine tokens to use to index the documents based on identified differences between the sets of tokens for the new versions of the documents and the sets of tokens for the current versions of the documents, and to generate index mutations including the tokens to use to index the documents, an index mutation journal configured to store the generated index mutations in association with timestamps, and an index mutation server configured to provide, to index servers, from the index mutation journal, generated index mutations for the index servers that are associated with timestamps that are newer than specified timestamps.

主权项

1. A method performed by one or more computing devices, the method comprising:
generating an index mutation comprising one or more tokens, wherein the index mutation is based at least in part on one or more identified differences between a new version of a document and a previous version of the document; storing the index mutation and an associated time-based value; comparing the time-based value associated with the index mutation to a time-based value associated with an index of the document; and based at least in part on the comparing, providing the one or more tokens of the index mutation to an index server.