System Design
per-key
tracked per user/IP/API-key
Source board
This definition comes from the board below. Open it to see the term in context.
The Bouncer at the DoorSystem DesignMore terms from this board
- 429Too Many Requests
- backoffwait longer each retry (+ jitter)
- bursta short spike
- distributed limitshared redis count, usually approximate
- fixed / sliding windowcount per clock-bucket / over a moving window
- leaky bucketqueue drains at a constant rate
- rate limitcap on requests per key per window
- Retry-Afterwhen to try again
- throttlingslow/reject once over the cap
- token bucketrefill r, hold B, spend 1 per request