Data parallel searching

摘要

A query that includes a search operator and that identifies an input data source is received. The input data source is partitioned into a plurality of partitions. A parallel search through the partitions is performed for an element that could halt the search. The parallel search is performed using a plurality of parallel workers. One of the parallel workers generates a notification when the element is found by that worker. The notification notifies the other parallel workers that the search could be halted. Each of the parallel workers generates an output set based on results of the search. The output sets are merged into a merged output set.

主权项

1. A computer-readable storage medium storing computer-executable instructions for performing a method comprising:
receiving a query that includes a search operator and that identifies an input data source; partitioning the input data source into a plurality of partitions; performing a parallel search through the partitions for an element that could halt the search using a plurality of parallel workers that concurrently search the partitions; generating a notification with one of the parallel workers when the element is found by that worker, thereby notifying other parallel workers that the search could be halted; and making a determination with each of the other parallel workers whether to continue performing the search based on the generated notification.