Reader small image

You're reading from  Cloud Scale Analytics with Azure Data Services

Product typeBook
Published inJul 2021
PublisherPackt
ISBN-139781800562936
Edition1st Edition
Right arrow
Author (1)
Patrik Borosch
Patrik Borosch
author image
Patrik Borosch

Patrik Borosch is a cloud solution architect for data and AI at Microsoft Switzerland GmbH. He has more than 25 years of BI and analytics development, engineering, and architecture experience and is a Microsoft Certified Data Engineer and a Microsoft Certified AI Engineer. Patrik has worked on numerous significant international data warehouse, data integration, and big data projects. Through this, he has built and extended his experience in all facets, from requirements engineering to data modeling and ETL, all the way to reporting and dashboarding. At Microsoft Switzerland, he supports customers in their journey into the analytical world of the Azure Cloud.
Read more about Patrik Borosch

Right arrow

Understanding the loading strategy with Synapse-dedicated SQL pools

The different options that you have available for the table design of a dedicated SQL pool, distributed or replicated tables, and the decision regarding the use of column stores or heaps and partitioning on top will influence the way in which you load data into it.

Certainly, loading into a hash-distributed table can be quite a quick process. But when you consider the additional compute step to calculate the hash keys to distribute the incoming rows to their target distribution and compare it to a round-robin-distributed table, where this step is not required, you can imagine that loading data into the latter will be faster.

Another consideration for a staging table in a dedicated SQL pool would be to use heap tables instead of column store ones. Again, you can avoid additional compute overhead for the column store and load data quickly.

In the end, it all comes down to performance. Therefore, following...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Cloud Scale Analytics with Azure Data Services
Published in: Jul 2021Publisher: PacktISBN-13: 9781800562936

Author (1)

author image
Patrik Borosch

Patrik Borosch is a cloud solution architect for data and AI at Microsoft Switzerland GmbH. He has more than 25 years of BI and analytics development, engineering, and architecture experience and is a Microsoft Certified Data Engineer and a Microsoft Certified AI Engineer. Patrik has worked on numerous significant international data warehouse, data integration, and big data projects. Through this, he has built and extended his experience in all facets, from requirements engineering to data modeling and ETL, all the way to reporting and dashboarding. At Microsoft Switzerland, he supports customers in their journey into the analytical world of the Azure Cloud.
Read more about Patrik Borosch