Struct WalPruneManager 

pub(crate) struct WalPruneManager {
    receiver: Receiver<Event>,
    procedure_manager: ProcedureManagerRef,
    tracker: WalPruneProcedureTracker,
    semaphore: Arc<Semaphore>,
    wal_prune_context: Context,
}

WalPruneManager manages all remote WAL related tasks in metasrv.

WalPruneManager is responsible for:

1. Registering WalPruneProcedure loader in the procedure manager.
2. Periodically receive Event::Tick to submit WalPruneProcedure to prune remote WAL.
3. Use a semaphore to limit the number of concurrent WalPruneProcedures.

Fields

receiver: Receiver<Event>

Receives Events.

procedure_manager: ProcedureManagerRef

Procedure manager.

tracker: WalPruneProcedureTracker

Tracker for running WalPruneProcedures.

semaphore: Arc<Semaphore>

Semaphore to limit the number of concurrent WalPruneProcedures.

wal_prune_context: Context

Context for WalPruneProcedure.

Implementations

impl WalPruneManager

pub fn new( parallelism: usize, receiver: Receiver<Event>, procedure_manager: ProcedureManagerRef, wal_prune_context: WalPruneContext, ) -> Self

Returns a new empty WalPruneManager.

pub async fn try_start(self) -> Result<()>

Start the WalPruneManager. It will register WalPruneProcedure loader in the procedure manager.

pub(crate) fn channel() -> (Sender<Event>, Receiver<Event>)

Returns a mpsc channel with a buffer capacity of 1024 for sending and receiving Event messages.

pub(crate) async fn run(&mut self)

Runs the main loop. Performs actions on received events.

• Tick: Submit limit WalPruneProcedures to prune remote WAL.

pub async fn wait_procedure( &self, topic_name: &str, prunable_entry_id: u64, ) -> Result<ProcedureId>

Submits a WalPruneProcedure for the given topic name.

async fn try_prune(&self, topic_name: &str) -> Result<()>

async fn handle_tick_request(&self) -> Result<()>

async fn retrieve_sorted_topics(&self) -> Result<Vec<String>>

Retrieve topics from the table metadata manager. Since WalPruneManager submits procedures depending on the order of the topics, we should sort the topics. TODO(CookiePie): Can register topics in memory instead of retrieving from the table metadata manager every time.