Module read

Expand description

Common structs and utilities for reading data.

Modules§

batch_adapter: Adapter to convert BoxedBatchIterator (primary key format) into an iterator of flat-format Arrow [RecordBatch]es, allowing memtable iterators that only produce Batch to feed into the flat read pipeline.
compat: Utilities to adapt readers with different schema.
dedup: Utilities to remove duplicate rows from a sorted batch.
flat_dedup: Dedup implementation for flat format.
flat_merge
flat_projection: Utilities for projection on flat format.
last_row: Utilities to read the last row of each time series.
projection: Utilities for projection operations.
prune 🔒
pruner 🔒: Pruner for parallel file pruning across scanner partitions.
range: Structs for partition ranges.
range_cache 🔒: Utilities for the partition range scan result cache.
scan_region: Scans a region according to the scan request.
scan_util: Utilities for scanners.
seq_scan 🔒: Sequential scan.
series_scan: Per-series scan implementation.
stream
unordered_scan 🔒: Unordered scanner.

Batch: Storage internal representation of a batch of rows for a primary key (time series).
BatchBuilder: Builder to build Batch.
BatchChecker 🔒: A struct to check the batch is monotonic.
BatchColumn: A column in a Batch.
ScannerMetrics 🔒: Local metrics for scanners.

FlatSource: Async [RecordBatch] reader and iterator wrapper for flat format.
Source: Async Batch reader and iterator wrapper.