Reader small image

You're reading from  Machine Learning Engineering with MLflow

Product typeBook
Published inAug 2021
PublisherPackt
ISBN-139781800560796
Edition1st Edition
Tools
Right arrow
Author (1)
Natu Lauchande
Natu Lauchande
author image
Natu Lauchande

Natu Lauchande is a principal data engineer in the fintech space currently tackling problems at the intersection of machine learning, data engineering, and distributed systems. He has worked in diverse industries, including biomedical/pharma research, cloud, fintech, and e-commerce/mobile. Along the way, he had the opportunity to be granted a patent (as co-inventor) in distributed systems, publish in a top academic journal, and contribute to open source software. He has also been very active as a speaker at machine learning/tech conferences and meetups.
Read more about Natu Lauchande

Right arrow

Understanding MLflow plugins

As an ML engineer, multiple times in your project you can reach the limits of a framework. MLflow provides an extension system through its plugin features. A plugin architecture allows the extensibility and adaptability of a software system.

MLflow allows the creation of the following types of plugins:

  • Tracking store plugins: This type of plugin controls and tweaks the store that you use to log your experiment metrics in a specific type of data store.
  • Artifact repository: You are able to override the artifact repositories with your own storage system—for example, adding an artifact repository based on the Hadoop Distributed File System (HDFS) or any object store specific to your environment, overriding API calls such as log_artifact and download_artifacts.
  • Running context providers: You can update how your system logs information about the context—for instance, tags such as git_tags and repo_uri, and other relevant elements...
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Machine Learning Engineering with MLflow
Published in: Aug 2021Publisher: PacktISBN-13: 9781800560796

Author (1)

author image
Natu Lauchande

Natu Lauchande is a principal data engineer in the fintech space currently tackling problems at the intersection of machine learning, data engineering, and distributed systems. He has worked in diverse industries, including biomedical/pharma research, cloud, fintech, and e-commerce/mobile. Along the way, he had the opportunity to be granted a patent (as co-inventor) in distributed systems, publish in a top academic journal, and contribute to open source software. He has also been very active as a speaker at machine learning/tech conferences and meetups.
Read more about Natu Lauchande