Reader small image

You're reading from  Transformers for Natural Language Processing - Second Edition

Product typeBook
Published inMar 2022
PublisherPackt
ISBN-139781803247335
Edition2nd Edition
Right arrow
Author (1)
Denis Rothman
Denis Rothman
author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman

Right arrow

Index

Symbols

345M-parameter GPT-2 model

downloading 509, 510

A

accuracy score 125

advanced prompt engineering 476, 477

ChatGPT prompts, building 479

keywords, adding 478

knowledge base for ChatGPT, building 477

knowledge base for GPT-4, building 477

moderation 479

quality control 479

user requests, parsing 478

AI-created content 458

model list 460, 461

opportunities 459

Allen Institute for AI

reference link 257

AllenNLP 343

URL 343

Amazon Web Services (AWS) 1, 12, 392

artificial intelligence, properties

computing power 6

data 5

model architecture 5

prompt engineering 6

attention heads 493

attention masks

creating 76

audio files

transcribing, with Whisper 483, 484

Automated Machine Learning (AutoML) 120

automatic question generation 303, 304

B

BERT-based transformer

architecture 258

basic samples 261-267

difficult samples 267-273

running...

lock icon
The rest of the chapter is locked
You have been reading a chapter from
Transformers for Natural Language Processing - Second Edition
Published in: Mar 2022Publisher: PacktISBN-13: 9781803247335
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
undefined
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €14.99/month. Cancel anytime

Author (1)

author image
Denis Rothman

Denis Rothman graduated from Sorbonne University and Paris-Diderot University, designing one of the very first word2matrix patented embedding and patented AI conversational agents. He began his career authoring one of the first AI cognitive Natural Language Processing (NLP) chatbots applied as an automated language teacher for Moet et Chandon and other companies. He authored an AI resource optimizer for IBM and apparel producers. He then authored an Advanced Planning and Scheduling (APS) solution used worldwide.
Read more about Denis Rothman