From Transformer to LLM
Papers Large AI Models Are Cultural and Social Technologies, Training language models to follow instructions with human feedback and Training Compute-Optimal Large Language Models
Included with a plan
This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Lessons that use this board
- From Transformer to LLMlesson
- The Bigram Modellesson
- The GPT Blocklesson
- Sampling and What Scale Buyslesson
From Transformer to LLM. FROM TRANSFORMER TO LLM
How LLMs Work · 05 — one objective + massive scale turns a transformer block into GPT / Claude
a transformer block (l.04) just shuffles token vectors. two i
Saved in this browser only.