pub struct PriorityLimiter { /* private fields */ }Expand description
Limits concurrent operations with high-priority admission and FIFO within each priority.
Each priority has its own wait timeout and optional queue limit; execution capacity is shared. A released permit goes directly to the oldest high-priority waiter, or else to the oldest normal-priority waiter, so sustained high-priority traffic can starve normal-priority waiters.
Implementations§
Source§impl PriorityLimiter
impl PriorityLimiter
Sourcepub fn new(
capacity: NonZeroU32,
normal_timeout: Duration,
high_timeout: impl Into<Option<Duration>>,
max_normal_queue_size: Option<u32>,
max_high_queue_size: Option<u32>,
) -> Self
pub fn new( capacity: NonZeroU32, normal_timeout: Duration, high_timeout: impl Into<Option<Duration>>, max_normal_queue_size: Option<u32>, max_high_queue_size: Option<u32>, ) -> Self
Creates a priority limiter with shared capacity and separate timeouts and queue limits.
Pass None as the high-priority timeout to wait without a deadline.
Sourcepub async fn acquire(&self, priority: Priority) -> Result<Permit>
pub async fn acquire(&self, priority: Priority) -> Result<Permit>
Acquires capacity within the timeout configured for the given priority.
Returns ErrorKind::AtCapacity when this priority’s queue is full or the wait times out.
Dropping the future releases its queue slot and any assigned permit.
Sourcepub fn stats(&self) -> PriorityLimiterStats
pub fn stats(&self) -> PriorityLimiterStats
Returns a snapshot of permits in use and queued acquisitions.
Sourcepub async fn run_emitter<F, Fut>(&self, emit: F) -> !
pub async fn run_emitter<F, Fut>(&self, emit: F) -> !
Passes this limiter’s stats to emit immediately and once per second thereafter.
Trait Implementations§
Source§impl Clone for PriorityLimiter
impl Clone for PriorityLimiter
Auto Trait Implementations§
impl Freeze for PriorityLimiter
impl RefUnwindSafe for PriorityLimiter
impl Send for PriorityLimiter
impl Sync for PriorityLimiter
impl Unpin for PriorityLimiter
impl UnsafeUnpin for PriorityLimiter
impl UnwindSafe for PriorityLimiter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T in a tonic::Request§impl<L> LayerExt<L> for L
impl<L> LayerExt<L> for L
§fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
Layered].