Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
The Definitive Guide to Data Integration

You're reading from  The Definitive Guide to Data Integration

Product type Book
Published in Mar 2024
Publisher Packt
ISBN-13 9781837631919
Pages 490 pages
Edition 1st Edition
Languages
Authors (4):
Pierre-Yves BONNEFOY Pierre-Yves BONNEFOY
Profile icon Pierre-Yves BONNEFOY
Emeric CHAIZE Emeric CHAIZE
Profile icon Emeric CHAIZE
Raphaël MANSUY Raphaël MANSUY
Profile icon Raphaël MANSUY
Mehdi TAZI Mehdi TAZI
Profile icon Mehdi TAZI
View More author details

Table of Contents (19) Chapters

Preface 1. Chapter 1: Introduction to Our Data Integration Journey 2. Chapter 2: Introducing Data Integration 3. Chapter 3: Architecture and History of Data Integration 4. Chapter 4: Data Sources and Types 5. Chapter 5: Columnar Data Formats and Comparisons 6. Chapter 6: Data Storage Technologies and Architectures 7. Chapter 7: Data Ingestion and Storage Strategies 8. Chapter 8: Data Integration Techniques 9. Chapter 9: Data Transformation and Processing 10. Chapter 10: Transformation Patterns, Cleansing, and Normalization 11. Chapter 11: Data Exposition and APIs 12. Chapter 12: Data Preparation and Analysis 13. Chapter 13: Workflow Management, Monitoring, and Data Quality 14. Chapter 14: Lineage, Governance, and Compliance 15. Chapter 15: Various Architecture Use Cases 16. Chapter 16: Prospects and Challenges 17. Index 18. Other Books You May Enjoy

Summary

In this chapter, we journeyed through the crucial components of data ingestion and storage strategies. We emphasized the importance of a well-structured and adaptable data ingestion and storage plan for organizations to proficiently manage and utilize their data.

We explored the concept of design by query and how it revolutionizes data modeling by focusing on end user needs. We also learned about the power of clustering to enhance performance, and we dove into the intricacies of Z-ordering for optimizing data storage and improving query performance. We examined the role of views and materialized views and their impact on performance and complexity. We also discussed the strategy of read replication to balance the load and improve performance, especially under heavy load.

Furthermore, we discovered various advanced data modeling techniques, such as partitioning, clustering, bucketing, and Z-ordering, and acknowledged their benefits, which include enhanced query performance...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}