Skip to main content

Module reader

Module reader 

Source
Expand description

Parquet reader.

ModulesΒ§

stream πŸ”’

MacrosΒ§

handle_index_error πŸ”’

StructsΒ§

FlatRowGroupReader πŸ”’
Reader to read a row group of a parquet file in flat format, returning RecordBatch.
MetadataCacheMetrics
Metrics for parquet metadata cache operations.
ParquetReader
Parquet batch reader to read our SST format.
ParquetReaderBuilder
Parquet SST reader builder.
PhysicalFilterContext πŸ”’
Context to evaluate a physical expression for a parquet file.
ReaderFilterMetrics πŸ”’
Metrics of filtering rows groups and rows.
ReaderMetrics
Parquet reader metrics.
RowGroupBuildContext πŸ”’
Context passed to RowGroupReaderBuilder::build() carrying all information needed for prefiltering decisions.
RowGroupReaderBuilder πŸ”’
Builder to build a parquet record batch stream for a row group.
SimpleFilterContext πŸ”’
Context to evaluate the column filter for a parquet file.

EnumsΒ§

MaybeFilter πŸ”’
The filter to evaluate or the prune result of the default value.

ConstantsΒ§

INDEX_TYPE_BLOOM πŸ”’
INDEX_TYPE_FULLTEXT πŸ”’
INDEX_TYPE_INVERTED πŸ”’
INDEX_TYPE_VECTOR πŸ”’
MAX_ROW_GROUPS_TO_CHECK_PK πŸ”’
Number of leading row groups sampled by should_read_pk_as_binary.

FunctionsΒ§

all_required_row_groups_searched πŸ”’
apply_selection_and_update_metrics πŸ”’
expr_is_immutable πŸ”’
has_row_level_selection πŸ”’
pruned_by_default πŸ”’
Prune a column by its default value. Returns false if we can’t create the default value or evaluate the filter.
should_read_pk_as_binary πŸ”’
Returns true if the __primary_key chunk in any of the first MAX_ROW_GROUPS_TO_CHECK_PK row groups exceeds the dictionary page size limit, signalling the writer likely fell back to plain encoding.
should_read_pk_as_binary_with_limit πŸ”’