Module bulk 

Memtable implementation for bulk load

Modules

chunk_reader 🔒

ChunkReader implementation for in-memory parquet bytes.

context

Context for iterating bulk memtable.

part

Bulk part encoder/decoder.

part_reader

row_group_reader 🔒

Structs

BulkMemtable

Memtable that ingests and scans parts directly.

BulkMemtableBuilder

Builder to build a BulkMemtable.

BulkMemtableConfig

Configuration for bulk memtable.

BulkPartWrapper 🔒

BulkParts 🔒

All parts in a bulk memtable.

BulkRangeIterBuilder

Iterator builder for bulk range

CollectedParts 🔒

Result of collecting parts to merge

CompactDispatcher

Scheduler to run compact tasks in background.

EncodedBulkRangeIterBuilder 🔒

Iterator builder for encoded bulk range

MemCompactTask 🔒

A memtable compact task to run in background.

MemtableCompactor 🔒

MergingFlagsGuard 🔒

RAII guard for managing merging flags. Automatically resets merging flags when dropped if the merge operation wasn’t successful.

MultiBulkRangeIterBuilder 🔒

Iterator builder for multi bulk range

Enums

MergedPart 🔒

Result of merging parts - either a MultiBulkPart or an EncodedBulkPart

PartToMerge 🔒

Enum to wrap different types of parts for unified merging.

Constants

DEFAULT_ENCODE_BYTES_THRESHOLD 🔒

Default bytes threshold for encoding.

DEFAULT_MAX_MERGE_GROUPS 🔒

Default maximum number of groups for parallel merging.

DEFAULT_MERGE_THRESHOLD 🔒

Default merge threshold for triggering compaction.

ENCODE_BYTES_THRESHOLD_DIVISOR 🔒

Divisor to derive the encode bytes threshold from the global write buffer size.

MAX_ENCODE_BYTES_THRESHOLD 🔒

Maximum bytes threshold for encoding when adapting to the write buffer size.

Statics

ENCODE_BYTES_THRESHOLD_OVERRIDE 🔒

Optional bytes threshold override from GREPTIME_BULK_ENCODE_BYTES_THRESHOLD.

ENCODE_ROW_THRESHOLD 🔒

Row threshold for encoding parts. Configurable via GREPTIME_BULK_ENCODE_ROW_THRESHOLD. When estimated rows exceed this threshold, parts are encoded as EncodedBulkPart.

MAX_MERGE_GROUPS 🔒

Maximum merge groups. Configurable via GREPTIME_BULK_MAX_MERGE_GROUPS.

MERGE_THRESHOLD 🔒

Threshold for triggering merge of parts. Configurable via GREPTIME_BULK_MERGE_THRESHOLD.

Functions

adaptive_encode_bytes_threshold 🔒

Computes the encode bytes threshold adapted to the global write buffer size: max(64 MiB, min(global_write_buffer_size / 32, 512 MiB)).

default_encode_bytes_threshold 🔒

Returns the default bytes threshold for encoding parts.

env_usize 🔒

Reads an environment variable as usize, returning default if not set or invalid.