Data Lake Development with Big Data

Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies
Preview in Mapt
Code Files

Data Lake Development with Big Data

Pradeep Pasupuleti, Beulah Salome Purra

2 customer reviews
Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies

Quick links: > What will you learn?> Table of content> Product reviews

eBook
$19.60
RRP $27.99
Save 29%
Print + eBook
$34.99
RRP $34.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$19.60
$34.99
RRP $27.99
RRP $34.99
eBook
Print + eBook

Frequently bought together


Data Lake Development with Big Data Book Cover
Data Lake Development with Big Data
$ 27.99
$ 19.60
Data Lake for Enterprises Book Cover
Data Lake for Enterprises
$ 18.49
$ 12.95
Buy 2 for $30.45
Save $16.03
Add to Cart

Book Details

ISBN 139781785888083
Paperback164 pages

Book Description

A Data Lake is a highly scalable platform for storing huge volumes of multistructured data from disparate sources with centralized data management services. This book explores the potential of Data Lakes and explores architectural approaches to building data lakes that ingest, index, manage, and analyze massive amounts of data using batch and real-time processing frameworks. It guides you on how to go about building a Data Lake that is managed by Hadoop and accessed as required by other Big Data applications.

This book will guide readers (using best practices) in developing Data Lake's capabilities. It will focus on architect data governance, security, data quality, data lineage tracking, metadata management, and semantic data tagging. By the end of this book, you will have a good understanding of building a Data Lake for Big Data.

Table of Contents

Chapter 1: The Need for Data Lake
Before the Data Lake
Need for Data Lake
Defining Data Lake
Key benefits of Data Lake
Challenges in implementing a Data Lake
When to go for a Data Lake implementation
Data Lake architecture
Summary
Chapter 2: Data Intake
Understanding Intake tier zones
Architectural guidance
Summary
Chapter 3: Data Integration, Quality, and Enrichment
Introduction to the Data Management Tier
Understanding Data Integration
Big Data tools and technologies
Summary
Chapter 4: Data Discovery and Consumption
Understanding the Data Consumption tier
Data Discovery and metadata
Data Provisioning and metadata
Architectural guidance
Summary
Chapter 5: Data Governance
Understanding Data Governance
Data Governance components
Architectural guidance
The current and future trends
Summary

What You Will Learn

  • Identify the need for a Data Lake in your enterprise context and learn to architect a Data Lake
  • Learn to build various tiers of a Data Lake, such as data intake, management, consumption, and governance, with a focus on practical implementation scenarios
  • Find out the key considerations to be taken into account while building each tier of the Data Lake
  • Understand Hadoop-oriented data transfer mechanism to ingest data in batch, micro-batch, and real-time modes
  • Explore various data integration needs and learn how to perform data enrichment and data transformations using Big Data technologies
  • Enable data discovery on the Data Lake to allow users to discover the data
  • Discover how data is packaged and provisioned for consumption
  • Comprehend the importance of including data governance disciplines while building a Data Lake

Authors

Table of Contents

Chapter 1: The Need for Data Lake
Before the Data Lake
Need for Data Lake
Defining Data Lake
Key benefits of Data Lake
Challenges in implementing a Data Lake
When to go for a Data Lake implementation
Data Lake architecture
Summary
Chapter 2: Data Intake
Understanding Intake tier zones
Architectural guidance
Summary
Chapter 3: Data Integration, Quality, and Enrichment
Introduction to the Data Management Tier
Understanding Data Integration
Big Data tools and technologies
Summary
Chapter 4: Data Discovery and Consumption
Understanding the Data Consumption tier
Data Discovery and metadata
Data Provisioning and metadata
Architectural guidance
Summary
Chapter 5: Data Governance
Understanding Data Governance
Data Governance components
Architectural guidance
The current and future trends
Summary

Book Details

ISBN 139781785888083
Paperback164 pages
Read More
From 2 reviews

Read More Reviews

Recommended for You

Data Lake for Enterprises Book Cover
Data Lake for Enterprises
$ 18.49
$ 12.95
Fast Data Processing with Spark 2 - Third Edition Book Cover
Fast Data Processing with Spark 2 - Third Edition
$ 31.99
$ 22.40
Hadoop: Data Processing and Modelling Book Cover
Hadoop: Data Processing and Modelling
$ 79.99
$ 56.00
Practical Data Analysis Book Cover
Practical Data Analysis
$ 29.99
$ 21.00
Getting Started with TensorFlow Book Cover
Getting Started with TensorFlow
$ 27.99
$ 19.60
Mastering Apache Spark 2.x - Second Edition Book Cover
Mastering Apache Spark 2.x - Second Edition
$ 39.99
$ 28.00