Module storage

Source

Structsยง

CHECKPOINT_RE ๐Ÿ”’
CheckpointMetadata ๐Ÿ”’
DELTA_RE ๐Ÿ”’
ManifestObjectStore

Enumsยง

FileKey ๐Ÿ”’
Key to identify a manifest file.

Constantsยง

DEFAULT_MANIFEST_COMPRESSION_TYPE ๐Ÿ”’
FALL_BACK_COMPRESS_TYPE ๐Ÿ”’
Due to backward compatibility, it is possible that the userโ€™s manifest file has not been compressed. So when we encounter problems, we need to fall back to FALL_BACK_COMPRESS_TYPE for processing.
FETCH_MANIFEST_PARALLELISM ๐Ÿ”’
LAST_CHECKPOINT_FILE ๐Ÿ”’

Functionsยง

checkpoint_checksum ๐Ÿ”’
checkpoint_file
delta_file
file_compress_type
Returnโ€™s the file compress algorithm by file extension.
file_version
Returnโ€™s the file manifest version from path
gen_path
is_checkpoint_file
is_delta_file
manifest_compress_type
Returns the CompressionType according to whether to compress manifest files.
verify_checksum ๐Ÿ”’