Inference
Labs The batch size dial and The temperature dial
Included with a plan
This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Lessons that use this board
- Inference (sampling, context, KV cache, hallucination)lesson
- The Maths Floor, Part 2: Probability, Softmax and Temperaturelesson
Inference. INFERENCE
How LLMs Work · 06 — how a trained model actually GENERATES text, and why it confidently makes things up
training (l.02,05) is done; the weights are frozen. INFERENCE = r
Saved in this browser only.