Struct Failing 

struct Failing {
    error: Arc<Error>,
    since: Instant,
    delay: Duration,
    probe_at: Option<Instant>,
    failed_creates: u64,
    rejected_appends: u64,
    logged_at: Instant,
}

The state of an enqueued store whose backlog the object store refuses with an error that requires intervention, see requires_intervention, such as denied access or a missing bucket.

Poisoning would drop the acknowledged backlog and need a restart, while such a cause can be fixed in place. So the backlog keeps its sequences and bytes, and its lowest pending batch is attempted alone, once nothing is in flight, after a delay that doubles from CREATE_RETRY_DELAY up to MAX_FAILING_RETRY_DELAY. Appends are rejected at once with a retryable error that carries the last error: they take no entry id and never wait behind the backlog. Releases fail with it too, and their records wait for a create. The first create that succeeds ends the state.

Fields

error: Arc<Error>

The last error a create met, which rejected appends carry.

since: Instant

delay: Duration

The delay before the next attempt is due once nothing is in flight.

probe_at: Option<Instant>

When the next attempt starts, None until it is scheduled.

failed_creates: u64

rejected_appends: u64

logged_at: Instant

Implementations

impl Failing

fn schedule(&mut self)

Schedules the next attempt after the current delay and doubles the delay for the one after it.

fn reject(&mut self) -> Error

Counts an admission the store refuses and returns the error it fails with.