18  Working with Pretrained Language Models

The reader has trained the GPT of Section 11.2 on a few hundred megabytes of text and has seen released models answer questions that model cannot. This chapter loads such a model, runs the same tensors in the book’s own code, scores it under explicit conventions, opens it, and reaches the models that no local machine can hold.