System Design
token bucket
refill r, hold B, spend 1 per request
Source board
This definition comes from the board below. Open it to see the term in context.
The Bouncer at the DoorSystem DesignMore terms from this board
- 429Too Many Requests
- backoffwait longer each retry (+ jitter)
- bursta short spike
- distributed limitshared redis count, usually approximate
- fixed / sliding windowcount per clock-bucket / over a moving window
- leaky bucketqueue drains at a constant rate
- per-keytracked per user/IP/API-key
- rate limitcap on requests per key per window
- Retry-Afterwhen to try again
- throttlingslow/reject once over the cap