Generic text completion with GPT-2
We will explore an example with a GPT-2 generic model from top to bottom. The goal of the example we will run is to determine the level of abstract reasoning a GPT model can attain.
This section describes the interaction with a GPT-2 model for text completion. We will focus on Step 9 of the OpenAI_GPT_2.ipynb notebook described in detail in Appendix III, Generic Text Completion with GPT-2.
You can first read this section to see how the generic pretrained GPT-2 model will react to a specific example. Then read Appendix III, Generic Text Completion with GPT-2, to go into the details of how a generic GPT-2 model is implemented in a Google Colab notebook.
You can also read Appendix III directly, which contains the interaction of Step 9 described below.
First, let’s understand the specific example of the pretrained GPT-2 being applied.
