24  Fine-Tuning

The reader has a pretrained model that continues text and a task it should do instead: follow an instruction, keep to a format, stop when the answer is complete, classify a message. Changing some weights on a few thousand examples is the oldest route, and the questions that remain are which weights may move, in what precision, on which examples, and what the base model forgets while they move.