| 摘要 |
Provided in the present invention is a software/hardware compression configurable big data processing system comprising: a file system compression layer, a software compression unit, a hardware compression unit, and a software-hardware synchronization unit, where the file system compression layer is located between a system-virtualized file system and a local file system and is connected to the software compression unit, the file system compression layer is connected to the hardware compression unit via a hardware driver layer, and the software-hardware synchronization unit is provided between the software compression unit and the hardware compression unit. The present invention takes into account a characteristic of a big data processing system and employs a scheme of consorted use of software and hardware for data compression processing, thus increasing system resource utilization rate and system execution efficiency. |
