Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Practical Deep Learning at Scale with MLflow

You're reading from  Practical Deep Learning at Scale with MLflow

Product type Book
Published in Jul 2022
Publisher Packt
ISBN-13 9781803241333
Pages 288 pages
Edition 1st Edition
Languages
Author (1):
Yong Liu Yong Liu
Profile icon Yong Liu

Table of Contents (17) Chapters

Preface Section 1 - Deep Learning Challenges and MLflow Prime
Chapter 1: Deep Learning Life Cycle and MLOps Challenges Chapter 2: Getting Started with MLflow for Deep Learning Section 2 –
Tracking a Deep Learning Pipeline at Scale
Chapter 3: Tracking Models, Parameters, and Metrics Chapter 4: Tracking Code and Data Versioning Section 3 –
Running Deep Learning Pipelines at Scale
Chapter 5: Running DL Pipelines in Different Environments Chapter 6: Running Hyperparameter Tuning at Scale Section 4 –
Deploying a Deep Learning Pipeline at Scale
Chapter 7: Multi-Step Deep Learning Inference Pipeline Chapter 8: Deploying a DL Inference Pipeline at Scale Section 5 – Deep Learning Model Explainability at Scale
Chapter 9: Fundamentals of Deep Learning Explainability Chapter 10: Implementing DL Explainability with MLflow Other Books You May Enjoy

Tracking model metrics

The default metric for the text classification model in the PyTorch lightning-flash package is Accuracy. If we want to change the metric to F1 score (a harmonic mean of precision and recall), which is a very common metric for measuring a classifier's performance, then we need to change the configuration of the classifier model before we start the model training process. Let's learn how to make this change and then use MLflow's non-auto-logging API to log the metrics:

  1. When defining the classifier variable, instead of using the default metric, we will pass a metric function called torchmetrics.F1 as a variable, as follows:
    classifier_model = TextClassifier(backbone="prajjwal1/bert-tiny", num_classes=datamodule.num_classes, metrics=torchmetrics.F1(datamodule.num_classes))

This uses the built-in metrics function of torchmetrics, the F1 module, along with the number of classes in the data we need to classify as a parameter. This...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}