System Design
throttling
slow/reject once over the cap
Source board
This definition comes from the board below. Open it to see the term in context.
The Bouncer at the DoorSystem DesignMore terms from this board
- 429Too Many Requests
- backoffwait longer each retry (+ jitter)
- bursta short spike
- distributed limitshared redis count, usually approximate
- fixed / sliding windowcount per clock-bucket / over a moving window
- leaky bucketqueue drains at a constant rate
- per-keytracked per user/IP/API-key
- rate limitcap on requests per key per window
- Retry-Afterwhen to try again
- token bucketrefill r, hold B, spend 1 per request