Expand description
Parquet writer.
Structsยง
- Object
Store Writer Factory - Parquet
Writer - Parquet SST writer.
- Size
Aware ๐Writer - Workaround for [AsyncArrowWriter] does not provide a method to get total bytes written after close.
- Source
Stats ๐ - SstWrite
Context ๐ - Protection and resource limits travel together for table-compaction output.
- SstWrite
Limits ๐ - Optional limits used by multi-output compaction. A batch may temporarily exceed the working threshold before its check; callers reserve that workspace.
- Write
Memory ๐ - Tracks retained footer memory across rolled files as well as the current file.
Enumsยง
- Flat
Batch ๐Converter - Converts a flat RecordBatch for writing to parquet.
- Series
Boundary ๐Split - Result of splitting a batch at the next series boundary.
- SstArrow
Writer ๐ - Arrow writer of the current SST file.
Traitsยง
- SstWrite
Guard - Registers durable ownership before either an SST or its index is published to storage.
- Writer
Factory
Functionsยง
- encoded_
primary_ ๐keys - Returns the dictionary keys and values of the encoded
__primary_keycolumn. - split_
at_ ๐next_ series - Splits
batchat the first row whose encoded primary key differs fromcurrent_primary_key, the last primary key written to the current file. - timestamp_
range_ ๐from_ array - Gets min and max timestamp from an timestamp array.