An adaptive column compression family for self-driving databases

Fehér, Marcell and Lucani, Daniel and Chatzigeorgiou, Ioannis (2022) An adaptive column compression family for self-driving databases. In: 13th International Workshop on Accelerating Analytics and Data Management Systems Using Modern Processor and Storage Architectures, 2022-09-05.

Text (ADMS22_feher)
ADMS22_feher.pdf - Published Version
Available under License Creative Commons Attribution-NoDerivs.
Download (2MB)

Abstract

Modern in-memory databases are typically used for high-performance workloads, therefore they have to be optimized for small memory footprint and high query speed at the same time. Data compression has the potential to reduce memory requirements but often reduces query speed too. In this paper we propose a novel, adaptive compressor that offers a new trade-off point of these dimensions, achieving better compression than LZ4 while reaching query speeds close to the fastest existing segment encoders. We evaluate our compressor both with synthetic data in isolation and on the TPC-H and Join Order Benchmarks, integrated into a modern relational column store, Hyrise.