Module data

Source
Expand description

Data part of a shard.

StructsΒ§

DataBatch
Data part batches returns by DataParts::read.
DataBatchRange πŸ”’
Range of a data batch.
DataBuffer
Buffer for the value part (pk_index, ts, sequence, op_type, field columns) in a shard.
DataBufferReader πŸ”’
DataBufferReaderBuilder πŸ”’
DataPartEncoder πŸ”’
DataPartReader
DataParts
Data parts under a shard.
DataPartsReader
Reader for all parts inside a DataParts.
DataPartsReaderBuilder
InnerKey πŸ”’
ParquetPart
Parquet-encoded DataPart.

EnumsΒ§

DataPart
Format of immutable data part.
LazyFieldVector πŸ”’
LazyMutableVectorBuilder πŸ”’

ConstantsΒ§

DATA_INIT_CAP πŸ”’
Initial capacity for the data buffer.
PK_INDEX_COLUMN_NAME πŸ”’

FunctionsΒ§

build_row_sort_indices_and_columns πŸ”’
build_rows_to_sort πŸ”’
drain_data_buffer_to_record_batches πŸ”’
Converts DataBuffer to record batches, with rows sorted according to pk_weights. dedup: whether to true to remove the duplicated rows inside DataBuffer. replace_pk_index: whether to replace the pk_index values with corresponding pk weight.
memtable_schema_to_encoded_schema πŸ”’
pk_index_array πŸ”’
Gets pk_index array from record batch.
search_next_pk_range πŸ”’
Searches for next pk index, and it’s offset range in a sorted UInt16Array.
timestamp_array_to_i64_slice πŸ”’