Book 04
How the model is trained
First the model practices next-word on a huge amount of text. Later it is shown example replies. Still later, scores and A-versus-B picks change what it prefers.
After this: Name the melting pot, the examples, then the flashlight. · 7 chapters · about 40 minutes
- 01First practice: the melting potPretraining5 min
- 02What the pot leaves behindFluent — and still sure Sydney is the capital5 min
- 03Show it the answer you wantDemonstrations5 min
- 04This is a question, not a blogInstruction following5 min
- 05A sticky note on a huge bookLoRA5 min
- 06One sofa vs a rare platypusScarce cases punch above their count5 min
- 07A flashlight, not a report cardEvals5 min