Packt+ | Advance your knowledge in tech

0

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Advanced Natural Language Processing with TensorFlow 2

You're reading from Advanced Natural Language Processing with TensorFlow 2 Build effective real-world NLP applications using NER, RNNs, seq2seq models, Transformers, and more

Product type Paperback

Published in Feb 2021

Publisher Packt

ISBN-13 9781800200937

Length 380 pages

Edition 1st Edition

Languages

Processing

Tools

Processing

Concepts

Mobile Application Development

Authors (2):

Ashish Bansal

Mullen

View More author details

Table of Contents (13) Chapters

Preface

1. Essentials of NLP

2. Understanding Sentiment in Natural Language with BiLSTMs FREE CHAPTER

3. Named Entity Recognition (NER) with BiLSTMs, CRFs, and Viterbi Decoding

4. Transfer Learning with BERT

5. Generating Text with RNNs and GPT-2

6. Text Summarization with Seq2seq Attention and Transformer Networks

7. Multi-Modal Networks and Image Captioning with ResNets and Transformer Networks

8. Weakly Supervised Learning for Classification with Snorkel

9. Building Conversational AI Applications with Deep Learning

10. Installation and Setup Instructions for Code

11. Other Books You May Enjoy

12. Index

Index

Symbols

VisualEncoder

Transformer model, training with 264

A

abstractive summaries

examples 186, 187

Adaptive Moment Estimation (Adam Optimizer) 119

Attention mechanism 123

Audio-Visual Speech Recognition (AVSR) 228

B

Bahdanau Attention 126

Bahdanau attention layer 197, 198, 199

Batch Normalization (BatchNorm) 245

beam search 171, 180

used, for decoding penalties 218, 219, 220

used for improving text summarization 214, 216, 217

BERT-based transfer learning 123

attention model 125, 127

encoder-decoder networks 123, 124

transformer model 128, 130

BERT fine-tuning approach

for SQuAD question answering 341, 342

bidirectional encoder representations from transformers (BERT) model 132, 133

about 131

custom layers, building 142, 143, 144, 145, 146, 147

normalization 133, 134, 135, 136, 137, 138, 139

sequences 135

tokenization 133, 134, 135, 136, 137, 138, 139

Bi-directional...

The rest of the chapter is locked

Visually different images

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Advanced Natural Language Processing with TensorFlow 2

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (2)

Ashish Bansal

Ashish Bansal

Ashish is an AI/ML leader, a well-known speaker, and an astute technologist with over 20 years of experience in the field. He has a Bachelor's in technology from IIT BHU, and an MBA in marketing from Kellogg School of Management. He is currently the Director of Recommendations at Twitch where he works on building scalable recommendation systems across a variety of product surfaces, connecting content to people. He has worked on recommendation systems at multiple organizations, most notably Twitter where he led Trends and Events recommendations and at Capital One where he worked on B2B and B2C products. Ashish was also a co-founder of GALE Partners, a full-service digital agency in Toronto, and spent over 9 years at SapientNitro, a leading digital agency.

See other products by Ashish Bansal

Mullen

Mullen

See other products by Mullen

Other recommended products

Related to this chapter

Getting Started with Google BERT

Getting Started with Google BERT

Getting Started with Google BERT will help you become well-versed with the BERT model from scratch and learn how to create interesting NLP applications. You'll understand several variants of BERT such as ALBERT, RoBERTa, DistilBERT, ELECTRA, VideoBERT, and many others in detail.

Jan 2021 11h 44m

Mastering Transformers

Mastering Transformers

Explore the accurate and fast fine-tuning capabilities of transformer-based language models and understand how they outperform traditional machine learning-based approaches when solving challenging NLU problems. Developers working with the Transformers architecture will be able to put their knowledge to work with this practical guide.

Sep 2021 12h 28m

Transformers for Natural Language Processing

Transformers for Natural Language Processing

Being the first book in the market to dive deep into the Transformers, it is a step-by-step guide for data and AI practitioners to help enhance the performance of language understanding and gain expertise with hands-on implementation of transformers using PyTorch, TensorFlow, Hugging Face, Trax, and AllenNLP.

Jan 2021 12h 48m

Hands-On Natural Language Processing with PyTorch 1.x

Hands-On Natural Language Processing with PyTorch 1.x

Developers working with NLP will be able to put their knowledge to work with this practical guide to PyTorch. You will learn to use PyTorch offerings and how to understand and analyze text using Python. You will learn to extract the underlying meaning in the text using deep neural networks and modern deep learning algorithms.

Jul 2020 9h 12m

Hands-On Natural Language Processing with Python

Hands-On Natural Language Processing with Python

This book teaches you to leverage deep learning models in performing various NLP tasks along with showcasing the best practices in dealing with the NLP challenges. The book equips you with practical knowledge to implement deep learning in your linguistic applications using NLTk and Python's popular deep learning library, TensorFlow.

Jul 2018 10h 24m

Natural Language Processing with TensorFlow

Natural Language Processing with TensorFlow

TensorFlow is the leading framework for deep learning algorithms critical to artificial intelligence, and natural language processing (NLP) makes much of the data used by deep learning applications accessible to them. This book brings the two together and teaches deep learning developers how to work with today's vast amount of unstructured data.

May 2018 15h 44m

Hands-On One-shot Learning with Python

Hands-On One-shot Learning with Python

This book is a step by step guide to one-shot learning using Python-based libraries. It is designed to help you understand and design models that can learn information about your data from one, or only a few, training examples. You will also learn to apply these techniques with real-world examples and datasets for classification and regression.

Apr 2020 5h 12m

Mastering spaCy

Mastering spaCy

Using machine learning-based NLP models, you can speed up business processes, make more accurate predictions, and uncover new insights from your existing data, where spaCy, an advanced industrial-grade natural language processing library, can help. With this book, you'll learn how to use it and create high-impact ML solutions for NLP.

Jul 2021 11h 52m

Deep Learning Essentials

Deep Learning Essentials

Deep Learning is one of the trending topics in the field of Artificial Intelligence today and can be considered to be an advanced form of machine learning. This book will help you take your first steps when it comes to training efficient deep learning models, and apply them in various practical scenarios. You will model, train and deploy different kinds of neural networks such as Convolutional Neural Network, Recurrent Neural Network, and see their applications in real-world domains such as computer vision, natural language processing, and speech recognition. This book also covers solutions to tackle different problems you might come across while training your models and ensure their high performance. This book does not assume any prior knowledge of deep learning. By the end of this book, you will have a firm understanding of the basics of deep learning and neural network modeling, along with their practical applications.

Jan 2018 9h 28m

Mastering PyTorch

Mastering PyTorch

Discover the flexibility of the PyTorch library for implementing new algorithms in a scalable and efficient way with this expert guide. This book will show you how to process data with deep learning methodologies using PyTorch 1.x and cover advanced topics such as GANs, Deep RL, and NLP using advanced deep learning techniques.

Feb 2021 15h 0m

Intelligent Projects Using Python

Intelligent Projects Using Python

This book includes 9 projects on building smart and practical AI-based systems. These projects cover solutions to different domain-specific problems in healthcare, e-commerce and more. With this book, you will apply different machine learning and deep learning techniques and learn how to build your own intelligent applications for smart predictions and other insight-driven tasks.

Jan 2019 11h 24m

Generative AI with Python and TensorFlow 2

Generative AI with Python and TensorFlow 2

Packed with intriguing real-world projects as well as theory, Generative AI with Python and TensorFlow 2 enables you to leverage artificial intelligence creatively and generate human-like data in the form of speech, text, images, and music.

Apr 2021 16h 16m