Reader small image

You're reading from  Transformers for Natural Language Processing - Second Edition

Product typeBook
Published inMar 2022
PublisherPackt
ISBN-139781803247335
Edition2nd Edition
Right arrow
Author (1)
Denis Rothman
Denis Rothman
author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman

Right arrow

Chapter 7, The Rise of Suprahuman Transformers with GPT-3 Engines

  1. A zero-shot method trains the parameters once. (True/False)

    False. No parameters are trained.

  1. Gradient updates are performed when running zero-shot models. (True/False)

    False.

  1. GPT models only have a decoder stack. (True/False)

    True.

  1. It is impossible to train a 117M GPT model on a local machine. (True/False)

    False. We trained one in this chapter.

  1. It is impossible to train the GPT-2 model with a specific dataset. (True/False)

    False. We trained one in this chapter.

  1. A GPT-2 model cannot be conditioned to generate text. (True/False)

    False. We implemented this in this chapter.

  1. A GPT-2 model can analyze the context of input and produce completion content. (True/False)

    True.

  1. We cannot interact with a 345M GTP parameter model on a machine with fewer than eight GPUs....
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Transformers for Natural Language Processing - Second Edition
Published in: Mar 2022Publisher: PacktISBN-13: 9781803247335

Author (1)

author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman