Skip to main content

Module parquet

Module parquet 

Source
Expand description

SST in parquet format.

Modulesยง

file_range
Structs and functions for reading ranges from a parquet file. A file range is usually a row group in a parquet file.
flat_format
Format to store in parquet.
format
Format to store in parquet.
helper ๐Ÿ”’
index_reader ๐Ÿ”’
Reader for standalone Parquet index files.
index_writer ๐Ÿ”’
json_align ๐Ÿ”’
metadata
prefilter
Prefilter framework for parquet reader.
push_decoder
Push decoder stream implementation for SST parquet files.
read_columns
reader
Parquet reader.
row_group
Parquet row group reading utilities.
row_selection
stats ๐Ÿ”’
Statistics of parquet SSTs.
writer
Parquet writer.

Structsยง

Json2TargetLayout ๐Ÿ”’
Fixed JSON2 physical layout used while rewriting compaction input.
SstInfo
Parquet SST info returned by the writer.
WriteOptions
Parquet write options.

Constantsยง

DEFAULT_READ_BATCH_SIZE ๐Ÿ”’
Default batch size to read parquet files.
DEFAULT_ROW_GROUP_SIZE
Default row group size for parquet files.
PARQUET_METADATA_KEY
Key of metadata in parquet SST.

Type Aliasesยง

Json2RewriteTargets ๐Ÿ”’
JSON2 physical layouts requested by a compaction read.