Prefill Decode Split
Included with a plan
This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Lessons that use this board
Prefill Decode Split. 04 · PREFILL / DECODE SPLIT — TWO POOLS, ONE KV IN FLIGHT
prefill wants a few sequences and thousands of tokens at once; decode wants dozens of sequences and one token each.
one po
Saved in this browser only.