Expand description
for declare Expression in dataflow, including map, reduce, id and join(TODO!) etc.
ModulesΒ§
- df_func π
- Porting Datafusion scalar function to our scalar function to be used in dataflow
- error π
- Error handling for expression evaluation.
- func π
- This module contains the definition of functions that can be used in expressions.
- id π
Id
is used to identify a dataflow component in plan likePlan::Get{id: Id}
, this could be a source of data for an arrangement.- linear π
- define MapFilterProject which is a compound operator that can be applied row-by-row.
- relation π
- Describes an aggregation function and itβs input expression.
- scalar π
- Scalar expressions.
- signature π
- Function signature, useful for type checking and function resolution.
- utils π
- This module contains utility functions for expressions.
StructsΒ§
- Batch
- A batch of vectors with the same length but without schema, only useful in dataflow
- Vector
Diff π - Vector with diff to note the insert and delete
- Vector
Diff πIter - iterator for VectorDiff