Fine-tuning and Alignment
Video RL fine-tuning: reward models, RLHF and DPO
Lab The LoRA rank
Papers Welcome to the Era of Experience, LoRA: Low-Rank Adaptation of Large Language Models, Direct Preference Optimization: Your Language Model is Secretly a Reward Model, Training language models to follow instructions with human feedback and Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Included with a plan
This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Lessons that use this board
Fine-tuning and Alignment. FINE-TUNING & ALIGNMENT
How LLMs Work · 07 — turning a raw next-token predictor into a helpful, harmless, honest ASSISTANT
the base model (l.05) KNOWS a lot but won't behave — ask
Saved in this browser only.