Index

Module 01 · AINeurons to a language model

From Transformer to LLM

From Transformer to LLM
From Transformer to LLM · Open board

The How LLMs Work board that takes the transformer block from Attention & the Transformer and asks the question left over: how does that become the thing you are talking to?

Before you start. The last lesson built a machine that takes a row of word-pieces and lets each absorb meaning from the ones before it, and How It Learns (loss, gradient descent, backprop) gave you the loop that turns a machine’s dials, the adjustable numbers inside it, whenever it gets an answer wrong. This lesson is the one exam question those two things were pointed at.

Continue reading with a plan

The first three lessons of every track are free. This lesson is included with a plan, which unlocks every lesson, board, video, lab and paper for one price.

View plans →Already a member? Sign in

Related paper

Review AI →

Saved in this browser, and to your account when you sign in.