Module read

Expand description

Common structs and utilities for reading data.

Modules§

batch_adapter: Adapter to convert BoxedBatchIterator (primary key format) into an iterator of flat-format Arrow [RecordBatch]es, allowing memtable iterators that only produce Batch to feed into the flat read pipeline.
compat: Utilities to adapt readers with different schema.
dedup: Utilities to remove duplicate rows from a sorted batch.
flat_dedup: Dedup implementation for flat format.
flat_merge
flat_projection: Utilities for projection on flat format.
last_row: Utilities to read the last row of each time series.
projection: Projection helpers shared by flat projection code.
prune 🔒
pruner 🔒: Pruner for parallel file pruning across scanner partitions.
range: Structs for partition ranges.
range_cache 🔒: Utilities for the partition range scan result cache.
read_columns
scan_region: Scans a region according to the scan request.
scan_util: Utilities for scanners.
seq_scan 🔒: Sequential scan.
series_candidate 🔒: Candidate metric-series discovery for the two-stage series scan.
series_reader 🔒: Reads selected metric series from partition ranges.
series_scan: Per-series scan implementation.
stream
unordered_scan 🔒: Unordered scanner.

Batch: Storage internal representation of a batch of rows for a primary key (time series).
BatchBuilder: Builder to build Batch.
BatchColumn: A column in a Batch.
DensePkCache 🔒: Only used when no fully decoded primary key was supplied by the reader.
FlatSource: Async [RecordBatch] reader and iterator wrapper for flat format.
ScannerMetrics 🔒: Local metrics for scanners.