Reader small image

You're reading from  Essential PySpark for Scalable Data Analytics

Product typeBook
Published inOct 2021
Reading LevelBeginner
PublisherPackt
ISBN-139781800568877
Edition1st Edition
Languages
Tools
Concepts
Right arrow
Author (1)
Sreeram Nudurupati
Sreeram Nudurupati
author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati

Right arrow

Advantages of data lakehouses

Data lakehouses address most of the challenges of using data warehouses and data lakes. Some advantages of using data lakehouses are that they reduce data redundancies, which are caused by two-tier systems such as a data lake along with a data warehouse in the cloud. This translates to reduced storage costs and simplified maintenance and data governance as any data governance features, such as access control and audit logging, can be implemented in a single place. This eliminates the operational overhead of managing data governance on multiple tools.

You should have all the data in a single storage system so that you have simplified data processing and ETL architectures, which also means easier to maintain and manage pipelines. Data engineers do not need to maintain separate code bases for disparate systems, and this greatly helps in reducing errors in data pipelines. It also makes it easier to track data lineage and fix data issues when they are identified...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Essential PySpark for Scalable Data Analytics
Published in: Oct 2021Publisher: PacktISBN-13: 9781800568877

Author (1)

author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati