Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Essential PySpark for Scalable Data Analytics

You're reading from  Essential PySpark for Scalable Data Analytics

Product type Book
Published in Oct 2021
Publisher Packt
ISBN-13 9781800568877
Pages 322 pages
Edition 1st Edition
Languages
Concepts
Author (1):
Sreeram Nudurupati Sreeram Nudurupati
Profile icon Sreeram Nudurupati

Table of Contents (19) Chapters

Preface Section 1: Data Engineering
Chapter 1: Distributed Computing Primer Chapter 2: Data Ingestion Chapter 3: Data Cleansing and Integration Chapter 4: Real-Time Data Analytics Section 2: Data Science
Chapter 5: Scalable Machine Learning with PySpark Chapter 6: Feature Engineering – Extraction, Transformation, and Selection Chapter 7: Supervised Machine Learning Chapter 8: Unsupervised Machine Learning Chapter 9: Machine Learning Life Cycle Management Chapter 10: Scaling Out Single-Node Machine Learning Using PySpark Section 3: Data Analysis
Chapter 11: Data Visualization with PySpark Chapter 12: Spark SQL Primer Chapter 13: Integrating External Tools with Spark SQL Chapter 14: The Data Lakehouse Other Books You May Enjoy

Classification

Classification is another type of supervised learning technique, where the task is to categorize a given dataset into different classes. Machine learning classifiers learn a mapping function from input parameters called Features that go to a discreet output parameter called Label. Here, the learning function tries to predict whether the label belongs to one of several known classes. The following diagram depicts the concept of classification:

Figure 7.2 – Logistic regression

In the preceding diagram, a logistic regression algorithm is learning a mapping function that divides the data points in a two-dimensional space into two distinct classes. The learning algorithm learns the coefficients of a Sigmoid function, which classifies a set of input parameters into one of two possible classes. This type of classification can be split into two distinct classes. This is known as binary classification or binomial classification.

Logistic regression...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}