Skip to main content

transform_logical_batches_to_physical

Function transform_logical_batches_to_physical 

Source
pub(super) fn transform_logical_batches_to_physical(
    table_batches: &[TableBatch],
    name_to_ids: &HashMap<String, u32>,
    partition_columns_set: &HashSet<&str>,
) -> Result<Vec<RecordBatch>>
Expand description

Transforms logical table batches into physical format (sparse primary key encoding).

It identifies tag columns and essential columns (timestamp, value) for each logical batch and applies sparse primary key modification.