System Design · Fan-out: tail latency
Thirty stalls on one order
Every stall is slow one time in a hundred. An order that waits on a hundred stalls is slow how often?
A wedding order of 900 cups is split across the chain, thirty cups from each stall, and the van leaves only when every stall is ready. Each stall is usually quick and now and then late. The curve and the grid of sample orders show how often the whole order is late.
Board: Query Serving →On a narrow screen the three readouts stack under the curve.
try this Drag Stalls on the order to 100, then switch to Hedge slow calls and watch Orders slow.
Included with a plan
This lab is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.