Reader small image

You're reading from  The AI Product Manager's Handbook

Product typeBook
Published inFeb 2023
Reading LevelIntermediate
PublisherPackt
ISBN-139781804612934
Edition1st Edition
Languages
Right arrow
Author (1)
Irene Bratsis
Irene Bratsis
author image
Irene Bratsis

Irene Bratsis is a director of digital product and data at the International WELL Building Institute (IWBI). She has a bachelor's in economics, and after completing various MOOCs in data science and big data analytics, she completed a data science program with Thinkful. Before joining IWBI, Irene worked as an operations analyst at Tesla, a data scientist at Gesture, a data product manager at Beekin, and head of product at Tenacity. Irene volunteers as NYC chapter co-lead for Women in Data, has coordinated various AI accelerators, moderated countless events with a speaker series with Women in AI called WaiTalk, and runs a monthly book club focused on data and AI books.
Read more about Irene Bratsis

Right arrow

Performance evaluation – testing, retraining, and hyperparameter tuning

MLOps helps us with accentuating the importance of retraining and hyperparameter tuning our models to deliver performance. Without having a built-out AI/ML pipeline that validates, trains, and retrains regularly, you won’t have a great handle on your product’s performance. Your MLOps team will essentially be made up of data scientists and ML and DL engineers that will be tasked with making adjustments to the hyperparameters of your model builds, testing those models, and retraining them when needed. This will need to be done in conjunction with managing the data needed to feed this testing, along with the code base for your product’s interface as well.

In addition to testing and validating the models and working to clean and explore the data, MLOps team members also traditionally do software testing such as code tests, unit testing, and integration testing. In many cases, your AI...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
The AI Product Manager's Handbook
Published in: Feb 2023Publisher: PacktISBN-13: 9781804612934

Author (1)

author image
Irene Bratsis

Irene Bratsis is a director of digital product and data at the International WELL Building Institute (IWBI). She has a bachelor's in economics, and after completing various MOOCs in data science and big data analytics, she completed a data science program with Thinkful. Before joining IWBI, Irene worked as an operations analyst at Tesla, a data scientist at Gesture, a data product manager at Beekin, and head of product at Tenacity. Irene volunteers as NYC chapter co-lead for Women in Data, has coordinated various AI accelerators, moderated countless events with a speaker series with Women in AI called WaiTalk, and runs a monthly book club focused on data and AI books.
Read more about Irene Bratsis