Scaling & Cost
Included with a plan
This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Lessons that use this board
Scaling & Cost. 06 - SCALING & COST
What you autoscale ON, what quantization buys, and why prefill and decode stopped living together.
1. THE TWO SLOS AND THE WRONG METRIC
TTFT: time to first toke
Saved in this browser only.