Reader small image

You're reading from  Transformers for Natural Language Processing and Computer Vision - Third Edition

Product typeBook
Published inFeb 2024
Reading LevelN/a
PublisherPackt
ISBN-139781805128724
Edition3rd Edition
Languages
Tools
Right arrow
Author (1)
Denis Rothman
Denis Rothman
author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman

Right arrow

Questions

  1. RoBERTa uses a byte-level byte-pair encoding tokenizer. (True/False)
  2. A trained Hugging Face tokenizer produces merges.txt and vocab.json. (True/False)
  3. RoBERTa does not use token-type IDs. (True/False)
  4. DistilBERT has 6 layers and 12 heads. (True/False)
  5. A transformer model with 80 million parameters is enormous. (True/False)
  6. We cannot train a tokenizer. (True/False)
  7. A BERT-like model has six decoder layers. (True/False)
  8. MLM predicts a word contained in a mask token in a sentence. (True/False)
  9. A BERT-like model has no self-attention sublayers. (True/False)
  10. Data collators are helpful for backpropagation. (True/False)
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Transformers for Natural Language Processing and Computer Vision - Third Edition
Published in: Feb 2024Publisher: PacktISBN-13: 9781805128724

Author (1)

author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman