Skip to main content

COLUMN_INDEX_TRUNCATE_LENGTH

Constant COLUMN_INDEX_TRUNCATE_LENGTH 

Source
pub(crate) const COLUMN_INDEX_TRUNCATE_LENGTH: Option<usize>;
Expand description

Truncation length of min/max values in the parquet column index.

Mito never reads the column index (it is skipped or stripped on load), so truncating it is safe. Chunk statistics stay untruncated because pruning decodes primary keys from them. Without truncation every page of a large string column stores its whole min and max values, uncompressed.

Truncated values are only bounds: code that starts reading the column index must not decode primary keys from it.