Trait DedupStrategy 

pub trait DedupStrategy: Send {
    // Required methods
    fn push_batch(
        &mut self,
        batch: Batch,
        metrics: &mut DedupMetrics,
    ) -> Result<Option<Batch>>;
    fn finish(&mut self, metrics: &mut DedupMetrics) -> Result<Option<Batch>>;
}

Strategy to remove duplicate rows from sorted batches.

Required Methods

fn push_batch( &mut self, batch: Batch, metrics: &mut DedupMetrics, ) -> Result<Option<Batch>>

Pushes a batch to the dedup strategy. Returns the deduplicated batch.

fn finish(&mut self, metrics: &mut DedupMetrics) -> Result<Option<Batch>>

Finishes the deduplication and resets the strategy.

Users must ensure that push_batch is called for all batches before calling this method.

Dyn Compatibility

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors

impl DedupStrategy for LastNonNull