Struct RangeBase 

pub(crate) struct RangeBase {
    pub(crate) filters: Vec<SimpleFilterContext>,
    pub(crate) read_format: ReadFormat,
    pub(crate) codec: Arc<dyn PrimaryKeyCodec>,
    pub(crate) compat_batch: Option<CompatBatch>,
    pub(crate) pre_filter_mode: PreFilterMode,
}

Common fields for a range to read and filter batches.

Fields

filters: Vec<SimpleFilterContext>

Filters pushed down.

read_format: ReadFormat

Helper to read the SST.

codec: Arc<dyn PrimaryKeyCodec>

Decoder for primary keys

compat_batch: Option<CompatBatch>

Optional helper to compat batches.

pre_filter_mode: PreFilterMode

Mode to pre-filter columns.

Implementations

impl RangeBase

pub(crate) fn precise_filter( &self, input: Batch, skip_fields: bool, ) -> Result<Option<Batch>>

TRY THE BEST to perform pushed down predicate precisely on the input batch. Return the filtered batch. If the entire batch is filtered out, return None.

Supported filter expr type is defined in [SimpleFilterEvaluator].

When a filter is referencing primary key column, this method will decode the primary key and put it into the batch.

Arguments

• input - The batch to filter
• skip_fields - Whether to skip field filters based on PreFilterMode and row group delete status

pub(crate) fn precise_filter_flat( &self, input: RecordBatch, skip_fields: bool, ) -> Result<Option<RecordBatch>>

Filters the input RecordBatch by the pushed down predicate and returns RecordBatch.

It assumes all necessary tags are already decoded from the primary key.

Arguments

• input - The RecordBatch to filter
• skip_fields - Whether to skip field filters based on PreFilterMode and row group delete status

pub(crate) fn compute_filter_mask_flat( &self, input: &RecordBatch, skip_fields: bool, ) -> Result<Option<BooleanBuffer>>

Computes the filter mask for the input RecordBatch based on pushed down predicates.

Returns None if the entire batch is filtered out, otherwise returns the boolean mask.

Arguments

• input - The RecordBatch to compute mask for
• skip_fields - Whether to skip field filters based on PreFilterMode and row group delete status