System Design
rate limit
cap on requests per key per window
Source board
This definition comes from the board below. Open it to see the term in context.
The Bouncer at the DoorSystem DesignMore terms from this board
- 429Too Many Requests
- backoffwait longer each retry (+ jitter)
- bursta short spike
- distributed limitshared redis count, usually approximate
- fixed / sliding windowcount per clock-bucket / over a moving window
- leaky bucketqueue drains at a constant rate
- per-keytracked per user/IP/API-key
- Retry-Afterwhen to try again
- throttlingslow/reject once over the cap
- token bucketrefill r, hold B, spend 1 per request