Skip to main content

transform_logical_batches_to_physical

Function transform_logical_batches_to_physical 

Source
fn transform_logical_batches_to_physical(
    table_batches: &[TableBatch],
    name_to_ids: &HashMap<String, u32>,
    partition_columns_set: &HashSet<&str>,
) -> Result<Vec<RecordBatch>>
Expand description

Transforms logical table batches into physical format (sparse primary key encoding).

It identifies tag columns and essential columns (timestamp, value) for each logical batch and applies sparse primary key modification.