Module prefilter 

Prefilter framework for parquet reader.

Prefilter optimization reduces I/O by reading only a subset of columns first (the prefilter phase), applying filters to compute a refined row selection, then reading the remaining columns with the refined selection.

Structs

BulkFilterPlan 🔒

How the bulk-memtable read should apply each predicate.

CachedPrimaryKeyFilter 🔒

PrefilterContext 🔒

Context for prefiltering a row group.

PrefilterContextBuilder 🔒

Pre-built state for constructing PrefilterContext per row group.

PrefilterEntry 🔒

PrefilterResult 🔒

Result of prefiltering a row group.

ReaderFilterPlan 🔒

How the parquet reader should apply each predicate.

Enums

PrefilterEntryKind 🔒

Constants

PREFILTER_COLUMN_RATIO_THRESHOLD 🔒

PREFILTER_MIN_REMAINING_COLUMNS 🔒

Functions

all_prefilter_entries 🔒

build_bulk_filter_plan 🔒

build_prefilter_cache_entries 🔒

build_prefilter_masks 🔒

build_reader_filter_plan 🔒

Splits a query [Predicate] into a ReaderFilterPlan: predicates that can run during the prefilter pass (on a reduced projection, to compute a refined row selection) versus predicates that must run on the normal read path (alongside the full projection).

compute_projection_count 🔒

compute_projection_mask 🔒

Executes prefiltering on a row group.

eval_entry_mask 🔒

eval_physical_filter_mask 🔒

eval_pk_group_mask 🔒

eval_simple_filter_mask 🔒

execute_prefilter 🔒

execute_prefilter_by_reading_columns 🔒

execute_prefilter_with_result_cache 🔒

matching_row_ranges_by_primary_key 🔒

non_cacheable_physical_filters 🔒

prefilter_column_names_for_entries 🔒

prefilter_flat_batch_by_primary_key 🔒

Filters a flat-format record batch by primary key, returning only rows whose primary key matches the filter. Returns None if all rows are filtered out.

projection_indices 🔒

refined_selection_from_mask 🔒

rows_before_filter 🔒

should_use_prefilter 🔒