Module filter 

Util record batch stream wrapper that can perform precise filter.

Structs

SimpleFilterEvaluator

An inplace expr evaluator for simple filter. Only support

Enums

TimestampUnitCast

The result of casting a SimpleFilterEvaluator to a different timestamp unit, preserving the predicate’s semantics on rows stored in that unit. See SimpleFilterEvaluator::cast_timestamp_unit.

Functions

batch_filter

Evaluate the predicate on the input RecordBatch, and return a new RecordBatch. Copy from datafusion::physical_plan::src::filter.rs

boolean_array_to_scan_mask 🔒

Converts nullable SQL predicate values to a scan mask, where NULL is false.

regexp_is_match_dictionary

Similar to regexp_is_match_scalar but for StringDictionaryArray. Iterates through dictionary keys to get string values and applies regex matching.

regexp_is_match_scalar

The same as arrow regexp_is_match_scalar() with pre-compiled regex. See https://github.com/apache/arrow-rs/blob/54.2.0/arrow-string/src/regexp.rs#L204-L246 for the implementation details.

timestamp_scalar 🔒

Builds a one-element scalar array holding value in unit.

timestamp_scalar_parts 🔒

Extracts the value and unit from a tz-naive timestamp scalar.

timestamp_scalar_value

Builds a tz-naive timestamp literal for value in unit.