Example code showing how to track ML model training in Databricks

Before proceeding, it’s important to ensure that you’ve already cloned the code repository that accompanies this book, as outlined in Chapter 3. Additionally, please verify that you have executed the associated notebook for Chapter 3. These preparatory steps are essential to fully engage with the content and exercises presented here:

1. Go to Chapter 04 and click on the mlflow-without-featurestore notebook:

Figure 4.3 – The code that accompanies this chapter

Make sure you have a cluster up and running and that the cluster is attached to this notebook, as you did with the notebook from Chapter 3, Utilizing the Feature Store.

2. Cmd 3 demonstrates the use of notebook-scoped libraries. These can be installed using the %pip magic command. As best practice, keep the %pip command as one of the topmost cells in your notebook as it restarts the Python interpreter...