Creation of inverted index system, and data processing method and apparatus

摘要

The present disclosure relate to techniques for establishing an inverted indexing system and related data processing. The techniques may include writing, by a computing device, inverted indexes of a massive amount of data records into at least one inverted file. The computing device may then write description information of the written inverted file into a description file associated with the inverted file, and establish the inverted indexing system based on the inverted file and the description file of the inverted file. The techniques enhance efficiency in establishing the inverted indexing system and in processing data using the systems.

主权项

1. A method for establishing an indexing system, the method comprising:
writing, by a computing device including one or more processors, multiple inverted indexes of data records into at least one inverted file; writing, by the computing device, description information of the at least one inverted file to a description file corresponding to the at least one inverted file; and establishing, by the computing device, the inverted indexing system based on the at least one inverted file and the description file corresponding to the at least one inverted file, wherein the establishing the inverted indexing system based on the at least one inverted file and the description file corresponding to the at least one inverted file comprises:
selecting an attribute of the data records as a function argument,retrieving a function value based on a predetermined functional mapping relation,combining the at least one inverted file and the description file corresponding to the at least one inverted file that corresponds to multiple data records that have the function value, into an indexing segment partition, andestablishing the inverted indexing system based on the indexing segment partition.