Module parquet 

SST in parquet format.

Modules

file_range

Structs and functions for reading ranges from a parquet file. A file range is usually a row group in a parquet file.

flat_format

Format to store in parquet.

format

Format to store in parquet.

helper 🔒

index_reader 🔒

Reader for standalone Parquet index files.

index_writer 🔒

json_align 🔒

metadata

prefilter

Prefilter framework for parquet reader.

push_decoder

Push decoder stream implementation for SST parquet files.

read_columns

reader

Parquet reader.

row_group

Parquet row group reading utilities.

row_selection

stats 🔒

Statistics of parquet SSTs.

writer

Parquet writer.

Structs

Json2TargetLayout 🔒

Fixed JSON2 physical layout used while rewriting compaction input.

SstInfo

Parquet SST info returned by the writer.

WriteOptions

Parquet write options.

Constants

COLUMN_INDEX_TRUNCATE_LENGTH 🔒

Truncation length of min/max values in the parquet column index.

DEFAULT_READ_BATCH_SIZE 🔒

Default batch size to read parquet files.

DEFAULT_ROW_GROUP_SIZE

Default row group size for parquet files.

PARQUET_METADATA_KEY

Key of metadata in parquet SST.

Functions

apply_column_compression 🔒

Applies the per-column options declared with COMPRESSION WITH (...).

apply_float_field_encoding 🔒

Applies the configured encoding to direct floating-point field columns.

apply_internal_column_encoding 🔒

Applies the encodings of the time index and internal columns shared by every SST writer.

Type Aliases

Json2RewriteTargets 🔒

JSON2 physical layouts requested by a compaction read.