Expand description
Pruner for parallel file pruning across scanner partitions.
Structsยง
- File
Builder ๐Entry - Per-file state tracking.
- Partition
Pruner - Local pruner in a partition that supports prefetching files to prune.
- Prune
Request ๐ - Request to prune a file.
- Pruner
- A pruner that prunes files for all partitions of a scanner.
- Pruner
Inner ๐ - Pruner
Options - Options to create a
Pruner.
Constantsยง
- PREFETCH_
COUNT ๐ - Number of files to pre-fetch ahead of the current position.
Functionsยง
- cache_
builder_ ๐if_ needed - Caches a freshly pruned builder if it is still referenced, and records the corresponding builder memory/count deltas for verbose metrics.
- should_
cache_ ๐builder - Returns true if a freshly pruned builder should be cached for this file.