Reader small image

You're reading from  Simplifying Data Engineering and Analytics with Delta

Product typeBook
Published inJul 2022
PublisherPackt
ISBN-139781801814867
Edition1st Edition
Concepts
Right arrow
Author (1)
Anindita Mahapatra
Anindita Mahapatra
author image
Anindita Mahapatra

Anindita Mahapatra is a Solutions Architect at Databricks in the data and AI space helping clients across all industry verticals reap value from their data infrastructure investments. She teaches a data engineering and analytics course at Harvard University as part of their extension school program. She has extensive big data and Hadoop consulting experience from Thinkbig/Teradata prior to which she was managing development of algorithmic app discovery and promotion for both Nokia and Microsoft AppStores. She holds a Masters degree in Liberal Arts and Management from Harvard Extension School, a Masters in Computer Science from Boston University and a Bachelors in Computer Science from BITS Pilani, India.
Read more about Anindita Mahapatra

Right arrow

Summary

Insights generated from ML models provide a competitive advantage to a business. However, the process is complex and there is a certain level of discipline that needs to be followed to maximize the return on investment. There are certain core components, such as a feature store, a model registry, a code repo, and a catalog, that are necessary to streamline the ML process, as it is very repetitive and it would be a shame to waste the valuable time of data scientists for tasks that are removed from the use case at hand. The model management aspects cannot be ignored either, because once created, an ML asset is a living, breathing entity that needs care and attention to ensure that it is performing as expected.

In this chapter, we looked at Delta through the lens of an ML practitioner and examined how it adds value to their day-to-day operations on several fronts, including feature engineering and reuse, model training with a unified view of the dataset, model reproducibility...

lock icon
The rest of the page is locked
Previous PageNext Chapter
You have been reading a chapter from
Simplifying Data Engineering and Analytics with Delta
Published in: Jul 2022Publisher: PacktISBN-13: 9781801814867

Author (1)

author image
Anindita Mahapatra

Anindita Mahapatra is a Solutions Architect at Databricks in the data and AI space helping clients across all industry verticals reap value from their data infrastructure investments. She teaches a data engineering and analytics course at Harvard University as part of their extension school program. She has extensive big data and Hadoop consulting experience from Thinkbig/Teradata prior to which she was managing development of algorithmic app discovery and promotion for both Nokia and Microsoft AppStores. She holds a Masters degree in Liberal Arts and Management from Harvard Extension School, a Masters in Computer Science from Boston University and a Bachelors in Computer Science from BITS Pilani, India.
Read more about Anindita Mahapatra