Skip to main content

Module filter

Module filter 

Source
Expand description

Util record batch stream wrapper that can perform precise filter.

Structs§

SimpleFilterEvaluator
An inplace expr evaluator for simple filter. Only support

Functions§

batch_filter
Evaluate the predicate on the input RecordBatch, and return a new RecordBatch. Copy from datafusion::physical_plan::src::filter.rs
regexp_is_match_dictionary
Similar to regexp_is_match_scalar but for StringDictionaryArray. Iterates through dictionary keys to get string values and applies regex matching.
regexp_is_match_scalar
The same as arrow regexp_is_match_scalar() with pre-compiled regex. See https://github.com/apache/arrow-rs/blob/54.2.0/arrow-string/src/regexp.rs#L204-L246 for the implementation details.