Reader small image

You're reading from  Transformers for Natural Language Processing and Computer Vision - Third Edition

Product typeBook
Published inFeb 2024
Reading LevelN/a
PublisherPackt
ISBN-139781805128724
Edition3rd Edition
Languages
Tools
Right arrow
Author (1)
Denis Rothman
Denis Rothman
author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman

Right arrow

Questions

  1. A tokenized dictionary contains every word that exists in a language. (True/False)
  2. Pretrained tokenizers can encode any dataset. (True/False)
  3. It is good practice to check a database before using it. (True/False)
  4. It is good practice to eliminate obscene data from datasets. (True/False)
  5. It is good practice to delete data containing discriminating assertions. (True/False)
  6. Raw datasets might sometimes produce relationships between noisy content and useful content. (True/False)
  7. A standard pretrained tokenizer contains the English vocabulary of the past 700 years. (True/False)
  8. Old English can create problems when encoding data with a tokenizer trained in modern English. (True/False)
  9. Medical and other types of jargon can create problems when encoding data with a tokenizer trained in modern English. (True/False)
  10. Controlling the output of the encoded data produced by a pretrained tokenizer is good practice. (True/False)
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Transformers for Natural Language Processing and Computer Vision - Third Edition
Published in: Feb 2024Publisher: PacktISBN-13: 9781805128724

Author (1)

author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman