Structsยง
- CHECKPOINT_
RE ๐ - Checkpoint
Metadata ๐ - DELTA_
RE ๐ - Manifest
Object Store
Enumsยง
- FileKey ๐
- Key to identify a manifest file.
Constantsยง
- DEFAULT_
MANIFEST_ ๐COMPRESSION_ TYPE - FALL_
BACK_ ๐COMPRESS_ TYPE - Due to backward compatibility, it is possible that the userโs manifest file has not been compressed.
So when we encounter problems, we need to fall back to
FALL_BACK_COMPRESS_TYPE
for processing. - FETCH_
MANIFEST_ ๐PARALLELISM - LAST_
CHECKPOINT_ ๐FILE
Functionsยง
- checkpoint_
checksum ๐ - checkpoint_
file - delta_
file - file_
compress_ type - Returnโs the file compress algorithm by file extension.
- file_
version - Returnโs the file manifest version from path
- gen_
path - is_
checkpoint_ file - is_
delta_ file - manifest_
compress_ type - Returns the CompressionType according to whether to compress manifest files.
- verify_
checksum ๐