Module rate_limits 

Admission-based rate limiting for throughput and bandwidth.

This module provides RateLimiter, which enforces configurable limits at three levels of granularity — global, per-usecase, and per-scope — for both request throughput (requests/s) and upload/download bandwidth (bytes/s).

General capacity limits reject with HTTP 503, while explicit throughput rules reject with HTTP 429. The first exceeded limit determines the rejection.

Throughput is enforced using token buckets. Bandwidth uses debt-based GCRA (Generic Cell Rate Algorithm) buckets that track a theoretical arrival time (TAT). All rate-limit checks are synchronous, non-blocking, and lock-free.

Structs

BandwidthHandle

Handle for recording bandwidth consumption against GCRA buckets.

BandwidthLimits

Bandwidth limits applied at global, per-usecase, and per-scope granularity.

RateLimiter

Combined rate limiter that enforces both bandwidth and throughput limits.

RateLimits

Rate limits for objectstore.

ThroughputLimits

Request throughput limits applied at global, per-usecase, and per-scope granularity.

ThroughputRule

An override rule that applies a specific throughput limit to matching request contexts.

Enums

LimitExceeded

Classifies a rejected request as capacity protection or an exceeded traffic allowance.

Constants

HEADER_ENVOY_RATELIMITED

Response header that prevents Envoy from retrying a response.