Episode 17 of 22 · AI, end to end
What fine-tuning actually is: prompting, retrieval, LoRA and the order to try them in
Included with a plan
This video is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.
Chapters
What fine-tuning actually is: prompting, retrieval, LoRA and the order to try them in. Three dials sit on the desk in front of you. Prompting. Retrieval. Fine tuning. People reach for the third one first, and almost always for a job the first two would have done. So
Based on the board Fine-tuning and Alignment.
Try it in the lab: The LoRA rank.
Related papers: LoRA: Low-Rank Adaptation of Large Language Models, Training language models to follow instructions with human feedback and Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.
Covered in Fine-tuning & Alignment, A LoRA Run.
Saved in this browser only.