26  Distillation and Reasoning

The reader has a 1.7B model that solves the arithmetic family after the reinforcement learning of Chapter 8, and a 0.6B model that does not. This chapter moves the capability into the smaller model, and then shows how to buy accuracy at the moment of answering with tokens instead of parameters.