DATA PROCESSING OVER VERY LARGE DATABASES

摘要

A system that facilitates data processing includes a receiver component t hat receives an SQL query. A partitioning component partitions the SQL query into multiple tasks and provides the tasks to multiple cluster nodes for pr ocessing. The system enables very large amounts of data (e.g., multiple tera bytes) to be quickly prepared for analytical processing, such as for use in connection with a search engine, an advertisement provision system, etc.