Module storage

Module storage 

Source

ModulesΒ§

checkpoint πŸ”’
delta πŸ”’
size_tracker πŸ”’
staging πŸ”’
utils πŸ”’

StructsΒ§

CHECKPOINT_RE πŸ”’
DELTA_RE πŸ”’
ManifestObjectStore

ConstantsΒ§

DEFAULT_MANIFEST_COMPRESSION_TYPE πŸ”’
FALL_BACK_COMPRESS_TYPE πŸ”’
Due to backward compatibility, it is possible that the user’s manifest file has not been compressed. So when we encounter problems, we need to fall back to FALL_BACK_COMPRESS_TYPE for processing.
FETCH_MANIFEST_PARALLELISM πŸ”’
LAST_CHECKPOINT_FILE

FunctionsΒ§

checkpoint_checksum πŸ”’
checkpoint_file
delta_file
file_compress_type
Return’s the file compress algorithm by file extension.
file_version
Return’s the file manifest version from path
gen_path
is_checkpoint_file
is_delta_file
manifest_compress_type
Returns the [CompressionType] according to whether to compress manifest files.
manifest_dir
Returns the directory to the manifest files.
verify_checksum πŸ”’