Identifying Files for Data Write Operations

摘要

Techniques for identifying files for data write operations are described. According to various embodiments, streams of mixed data are sorted based on various criteria and/or filters to generate individual sets of like data. The data sets are buffered in individual data queues in preparation to be written to persistent storage. According to various embodiments, files are requested for storing the data sets. For instance, a file request is submitted that includes write parameters for a data set. Based on the write parameters, a file is identified and selected for storing the data set. An identifier for the file is provided that enables the data set to be written to the file.

主权项

1. A system comprising:
at least one processor; and one or more computer-readable storage media including instructions stored thereon that, responsive to execution by the at least one processor, cause the system perform operations including:
receiving a request for a file for a data write operation for a data set, the request identifying a category of data included in the data set;identifying a file that is available for the data write operation by scanning a collection of available files to ascertain whether at least one file of the available files matches the category of data indicated by the request;communicating a pointer to the file, the pointer being usable to write the data set to the file;receiving an indication that the data write operation to the file has been performed;ascertaining whether the data write operation to the file is successful; andcommunicating a notification indicating whether the data write operation is successful.