Reader small image

You're reading from  Essential PySpark for Scalable Data Analytics

Product typeBook
Published inOct 2021
Reading LevelBeginner
PublisherPackt
ISBN-139781800568877
Edition1st Edition
Languages
Tools
Concepts
Right arrow
Author (1)
Sreeram Nudurupati
Sreeram Nudurupati
author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati

Right arrow

Introduction to the ML life cycle

The ML life cycle is a continuous process that a data science project follows. It contains four major stages, starting with data collection and preparation, model training, model evaluation, and finally model inferencing and monitoring. The ML process is a continuous one, where the cycle iterates between improving the data and constantly improving the model's performance; or, rather, keeping it from degrading over time:

Figure 9.1 – ML life cycle

The previous diagram presents the continuous process of ML life cycle management, from data preparation to model development, and then from training to model deployment and monitoring. When model performance degrades due to either a change in the training data or the model code or changes in model parameters, the cyclic process starts all over again.

Processes for data collection and preparation, cleansing, and consolidation, as well as techniques for training various...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Essential PySpark for Scalable Data Analytics
Published in: Oct 2021Publisher: PacktISBN-13: 9781800568877

Author (1)

author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati