Struct SourceSender

pub struct SourceSender {
    sender: Sender<Batch>,
    send_buf_tx: Sender<Batch>,
    send_buf_rx: RwLock<Receiver<Batch>>,
    send_buf_row_cnt: AtomicUsize,
}

a simple broadcast sender with backpressure, bounded capacity and blocking on send when send buf is full note that it wouldn’t evict old data, so it’s possible to block forever if the receiver is slow

receiver still use tokio broadcast channel, since only sender side need to know backpressure and adjust dataflow running duration to avoid blocking

Fields

sender: Sender<Batch>

send_buf_tx: Sender<Batch>

send_buf_rx: RwLock<Receiver<Batch>>

send_buf_row_cnt: AtomicUsize

Implementations

impl SourceSender

const MAX_ITERATIONS: usize = 16usize

max number of iterations to try flush send buf

pub fn get_receiver(&self) -> Receiver<Batch>

pub async fn try_flush(&self) -> Result<usize, Error>

send as many as possible rows from send buf until send buf is empty or broadchannel is full

pub async fn send_rows( &self, rows: Vec<(Row, i64, i64)>, batch_datatypes: &[ConcreteDataType], ) -> Result<usize, Error>

return number of rows it actual send(including what’s in the buffer)

pub async fn send_record_batch( &self, batch: RecordBatch, ) -> Result<usize, Error>

send record batch

Trait Implementations

impl Debug for SourceSender

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SourceSender

fn default() -> Self

Returns the “default value” for a type.