Reader small image

You're reading from  Essential PySpark for Scalable Data Analytics

Product typeBook
Published inOct 2021
Reading LevelBeginner
PublisherPackt
ISBN-139781800568877
Edition1st Edition
Languages
Tools
Concepts
Right arrow
Author (1)
Sreeram Nudurupati
Sreeram Nudurupati
author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati

Right arrow

Ingesting data into data sinks

A data sink, as its name suggests, is a storage layer for storing raw or processed data either for short-term staging or long-term persistent storage. Though the term of data sink is commonly used in real-time data processing, there is no specific harm in calling any storage layer where ingested data lands a data sink. Just like data sources, there are also different types of data sinks. You will learn about a few of the most common ones in the following sections.

Ingesting into data warehouses

Data warehouses are a specific type of persistent data storage most prominent in Business Intelligence type workloads. There is an entire field of study dedicated to Business Intelligence and data warehousing. Typically, a data warehouse uses an RDBMS as its data store. However, a data warehouse is different from a traditional database in that it follows a specific type of data modeling technique, called dimensional modeling. Dimensional models are very intuitive...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Essential PySpark for Scalable Data Analytics
Published in: Oct 2021Publisher: PacktISBN-13: 9781800568877

Author (1)

author image
Sreeram Nudurupati

Sreeram Nudurupati is a data analytics professional with years of experience in designing and optimizing data analytics pipelines at scale. He has a history of helping enterprises, as well as digital natives, build optimized analytics pipelines by using the knowledge of the organization, infrastructure environment, and current technologies.
Read more about Sreeram Nudurupati