Module sst

Module sst 

Source
Expand description

Sorted strings tables.

Modulesยง

file
Structures to describe metadata of files.
file_purger
file_ref
index
location
parquet
SST in parquet format.
version ๐Ÿ”’
SST version.

Structsยง

FlatSchemaOptions
Options of flat schema.
SeriesEstimator ๐Ÿ”’
Gets the estimated number of series from record batches.

Enumsยง

FormatType
Format type of the SST file.

Constantsยง

DEFAULT_WRITE_BUFFER_SIZE
Default write buffer size, it should be greater than the default minimum upload part of S3 (5mb).
DEFAULT_WRITE_CONCURRENCY
Default number of concurrent write, it only works on object store backend(e.g., S3).

Functionsยง

flat_sst_arrow_schema_column_num
Returns the number of columns in the flat format.
internal_fields ๐Ÿ”’
Fields for internal columns.
plain_internal_fields ๐Ÿ”’
Fields for internal columns.
tag_maybe_to_dictionary_field ๐Ÿ”’
Helper function to create a dictionary field from a field if it is a string column.
to_dictionary_field ๐Ÿ”’
Helper function to create a dictionary field from a field.
to_flat_sst_arrow_schema
Gets the arrow schema to store in parquet.
to_plain_sst_arrow_schema
Gets the arrow schema to store in parquet.
to_sst_arrow_schema
Gets the arrow schema to store in parquet.