Reader small image

You're reading from  Transformers for Natural Language Processing and Computer Vision - Third Edition

Product typeBook
Published inFeb 2024
Reading LevelN/a
PublisherPackt
ISBN-139781805128724
Edition3rd Edition
Languages
Tools
Right arrow
Author (1)
Denis Rothman
Denis Rothman
author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman

Right arrow

Fine-tuned for classification (discriminative)

The miracle of generative models, such as GPTs, is that they can perform a classification task with the right prompts!In this section, we will fine-tune babbage-002 to classify baseball and hockey text inputs. You will see that you can fine-tune an original OpenAI model to a wide range of tasks. Your imagination will be the limit!Open Fine-tuned_classification.ipynb in the chapter directory in the GitHub repository. The structure of the notebook is the same as Fine_tuning_GPT_3.ipynb notebook we just created. The main section titles are identical.Fine_tuning_GPT_3.ipynb was created for completion tasks with text as a prompt and completion, although you can modify it for any other NLP task. Fine-tuned_classification.ipynb is designed to classify baseball and hockey texts. You can adapt this notebook to other NLP tasks once you have explored it.The dataset is designed for classification tasks, but the process is the same as the one we went...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Transformers for Natural Language Processing and Computer Vision - Third Edition
Published in: Feb 2024Publisher: PacktISBN-13: 9781805128724

Author (1)

author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman