Skip to main content

Module flat_merge

Module flat_merge 

Source

Structsยง

BatchBuilder
Provides an API to incrementally build a [RecordBatch] from partitioned [RecordBatch]
BatchCursor ๐Ÿ”’
Keeps track of the current position in a batch
FlatMergeIterator
Iterator to merge multiple sorted iterators into a single sorted iterator.
FlatMergeReader
Iterator to merge multiple sorted iterators into a single sorted iterator.
GenericNode ๐Ÿ”’
A sync node in the merge iterator.
MergeAlgo ๐Ÿ”’
Common algorithm of merging sorted batches from multiple nodes.
MergeMetrics
Metrics for the merge reader.
RowCursor ๐Ÿ”’
Cursor to a row in the [RecordBatch].
SortColumns ๐Ÿ”’
Columns to compare for a [RecordBatch].

Traitsยง

MergeMetricsReport
Trait for reporting merge metrics.
NodeCmp ๐Ÿ”’
A comparable node of the heap.

Functionsยง

check_interleave_bytes_overflow ๐Ÿ”’
Checks whether interleaving the selected rows from byte columns would overflow i32 offsets. Similar to arrow-rs interleave_bytes(), accumulates offsets and returns an error if the capacity exceeds i32::MAX.
check_interleave_overflow ๐Ÿ”’
Checks whether interleave() would overflow i32 offsets for Utf8 or Binary columns.

Type Aliasesยง

IterNode ๐Ÿ”’
StreamNode ๐Ÿ”’