Reader small image

You're reading from  Practical Guide to Applied Conformal Prediction in Python

Product typeBook
Published inDec 2023
PublisherPackt
ISBN-139781805122760
Edition1st Edition
Right arrow
Author (1)
Valery Manokhin
Valery Manokhin
author image
Valery Manokhin

Valeriy Manokhin is the leading expert in the field of machine learning and Conformal Prediction. He holds a Ph.D.in Machine Learning from Royal Holloway, University of London. His doctoral work was supervised by the creator of Conformal Prediction, Vladimir Vovk, and focused on developing new methods for quantifying uncertainty in machine learning models. Valeriy has published extensively in leading machine learning journals, and his Ph.D. dissertation 'Machine Learning for Probabilistic Prediction' is read by thousands of people across the world. He is also the creator of "Awesome Conformal Prediction," the most popular resource and GitHub repository for all things Conformal Prediction.
Read more about Valery Manokhin

Right arrow

Classifier calibration

Most statistical, machine learning, and deep learning models output predicted class labels, and the models are typically evaluated in terms of their accuracy.

Accuracy is a prevalent measure for assessing the performance of a machine learning classification model. It quantifies the ratio of instances that are correctly identified to the overall count in the dataset. In other words, accuracy tells us how often the model’s predictions align with the true labels of the data.

The accuracy score measures how often the model’s predictions match the true observed labels. It is calculated as the fraction of correct predictions out of all predictions made. Accuracy scores between 0 and 1 quantify how accurate the model’s predictions are compared to the ground truth data. A higher accuracy score close to 1 signifies that the model is performing very accurately overall, with most of its predictions being correct. A lower accuracy approaching 0...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Practical Guide to Applied Conformal Prediction in Python
Published in: Dec 2023Publisher: PacktISBN-13: 9781805122760

Author (1)

author image
Valery Manokhin

Valeriy Manokhin is the leading expert in the field of machine learning and Conformal Prediction. He holds a Ph.D.in Machine Learning from Royal Holloway, University of London. His doctoral work was supervised by the creator of Conformal Prediction, Vladimir Vovk, and focused on developing new methods for quantifying uncertainty in machine learning models. Valeriy has published extensively in leading machine learning journals, and his Ph.D. dissertation 'Machine Learning for Probabilistic Prediction' is read by thousands of people across the world. He is also the creator of "Awesome Conformal Prediction," the most popular resource and GitHub repository for all things Conformal Prediction.
Read more about Valery Manokhin