Reader small image

You're reading from  Natural Language Understanding with Python

Product typeBook
Published inJun 2023
PublisherPackt
ISBN-139781804613429
Edition1st Edition
Right arrow
Author (1)
Deborah A. Dahl
Deborah A. Dahl
author image
Deborah A. Dahl

Deborah A. Dahl is the principal at Conversational Technologies, with over 30 years of experience in natural language understanding technology. She has developed numerous natural language processing systems for research, commercial, and government applications, including a system for NASA, and speech and natural language components on Android. She has taught over 20 workshops on natural language processing, consulted on many natural language processing applications for her customers, and written over 75 technical papers. Th is is Deborah's fourth book on natural language understanding topics. Deborah has a PhD in linguistics from the University of Minnesota and postdoctoral studies in cognitive science from the University of Pennsylvania.
Read more about Deborah A. Dahl

Right arrow

Topic modeling using clustering techniques and label derivation

We’ll start our exploration of topic modeling by looking at some considerations relating to grouping semantically similar documents in general, and then we’ll look at a specific example.

Grouping semantically similar documents

Like most of the machine learning problems we’ve discussed so far, the overall task generally breaks down into two sub-problems, representing the data and performing a task based on the representations. We’ll look at these two sub-problems next.

Representing the data

The data representations we’ve looked at so far were reviewed in Chapter 7. These approaches included the simple bag of words (BoW) variants, term frequency - inverse document frequency (TF-IDF), and newer approaches, including Word2Vec. Word2Vec is based on word vectors, which are vectors that represent words in isolation, without taking into account the context in which they occur. A newer...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Natural Language Understanding with Python
Published in: Jun 2023Publisher: PacktISBN-13: 9781804613429

Author (1)

author image
Deborah A. Dahl

Deborah A. Dahl is the principal at Conversational Technologies, with over 30 years of experience in natural language understanding technology. She has developed numerous natural language processing systems for research, commercial, and government applications, including a system for NASA, and speech and natural language components on Android. She has taught over 20 workshops on natural language processing, consulted on many natural language processing applications for her customers, and written over 75 technical papers. Th is is Deborah's fourth book on natural language understanding topics. Deborah has a PhD in linguistics from the University of Minnesota and postdoctoral studies in cognitive science from the University of Pennsylvania.
Read more about Deborah A. Dahl