Reader small image

You're reading from  Practical Guide to Applied Conformal Prediction in Python

Product typeBook
Published inDec 2023
PublisherPackt
ISBN-139781805122760
Edition1st Edition
Right arrow
Author (1)
Valery Manokhin
Valery Manokhin
author image
Valery Manokhin

Valeriy Manokhin is the leading expert in the field of machine learning and Conformal Prediction. He holds a Ph.D.in Machine Learning from Royal Holloway, University of London. His doctoral work was supervised by the creator of Conformal Prediction, Vladimir Vovk, and focused on developing new methods for quantifying uncertainty in machine learning models. Valeriy has published extensively in leading machine learning journals, and his Ph.D. dissertation 'Machine Learning for Probabilistic Prediction' is read by thousands of people across the world. He is also the creator of "Awesome Conformal Prediction," the most popular resource and GitHub repository for all things Conformal Prediction.
Read more about Valery Manokhin

Right arrow

The efficiency of probabilistic predictors

Efficiency is a performance metric used to evaluate probabilistic predictors. It measures how precise or informative the prediction intervals or regions are. In other words, efficiency indicates how tight or narrow the predicted probability distributions are. Smaller intervals or regions are considered more efficient, as they convey more certainty about the predicted outcomes.

While validity focuses on ensuring that the error rate is controlled, efficiency assesses the usefulness and precision of the predictions. An efficient predictor provides more specific information about the possible outcomes, whereas a less efficient predictor generates wider intervals or regions, resulting in less precise information.

There is an inherent trade-off between validity and efficiency. A conformal predictor can always achieve perfect validity by outputting very wide prediction sets that encompass all possible outcomes. However, this lacks efficiency...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Practical Guide to Applied Conformal Prediction in Python
Published in: Dec 2023Publisher: PacktISBN-13: 9781805122760

Author (1)

author image
Valery Manokhin

Valeriy Manokhin is the leading expert in the field of machine learning and Conformal Prediction. He holds a Ph.D.in Machine Learning from Royal Holloway, University of London. His doctoral work was supervised by the creator of Conformal Prediction, Vladimir Vovk, and focused on developing new methods for quantifying uncertainty in machine learning models. Valeriy has published extensively in leading machine learning journals, and his Ph.D. dissertation 'Machine Learning for Probabilistic Prediction' is read by thousands of people across the world. He is also the creator of "Awesome Conformal Prediction," the most popular resource and GitHub repository for all things Conformal Prediction.
Read more about Valery Manokhin