Skip to main content

build_index_from_parquet_bytes

Function build_index_from_parquet_bytes 

Source
pub(crate) async fn build_index_from_parquet_bytes(
    builder: &IndexerBuilderImpl,
    region_file_id: RegionFileId,
    data: &Bytes,
) -> IndexOutput
Expand description

Builds the indexes of an SST from its encoded parquet bytes.

Encoded bulk parts are flushed without passing through ParquetWriter, so their indexes are built from the bytes still in memory instead of reading the uploaded SST back. Like the writer, a failure only drops the index and leaves the SST unindexed.