Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Data Wrangling on AWS

You're reading from  Data Wrangling on AWS

Product type Book
Published in Jul 2023
Publisher Packt
ISBN-13 9781801810906
Pages 420 pages
Edition 1st Edition
Languages
Authors (3):
Navnit Shukla Navnit Shukla
Profile icon Navnit Shukla
Sankar M Sankar M
Profile icon Sankar M
Sampat Palani Sampat Palani
Profile icon Sampat Palani
View More author details

Table of Contents (19) Chapters

Preface 1. Part 1:Unleashing Data Wrangling with AWS
2. Chapter 1: Getting Started with Data Wrangling 3. Part 2:Data Wrangling with AWS Tools
4. Chapter 2: Introduction to AWS Glue DataBrew 5. Chapter 3: Introducing AWS SDK for pandas 6. Chapter 4: Introduction to SageMaker Data Wrangler 7. Part 3:AWS Data Management and Analysis
8. Chapter 5: Working with Amazon S3 9. Chapter 6: Working with AWS Glue 10. Chapter 7: Working with Athena 11. Chapter 8: Working with QuickSight 12. Part 4:Advanced Data Manipulation and ML Data Optimization
13. Chapter 9: Building an End-to-End Data-Wrangling Pipeline with AWS SDK for Pandas 14. Chapter 10: Data Processing for Machine Learning with SageMaker Data Wrangler 15. Part 5:Ensuring Data Lake Security and Monitoring
16. Chapter 11: Data Lake Security and Monitoring 17. Index 18. Other Books You May Enjoy

What is Apache Spark?

Apache Spark is a unified analytics engine for processing big data, developed as an open source project in 2009 at the University of California, Berkeley’s AMPLab. Initially, it was created as a class project to address the limitations of the Hadoop framework in exchanging data between iterations through HDFS for machine learning use cases. The objective was to design a new framework for fast interactive processing, including machine learning and interactive data analysis, while retaining the implicit data parallelism and fault tolerance of MapReduce and HDFS from the Hadoop framework. It incorporates in-memory caching and is optimized for analytics workloads of any size.

Apache Spark was open sourced in 2010 under a BSD License, and in 2013, the project was contributed to the Apache Software Foundation. In 2014, Spark became a top-level Apache project. It has garnered over 1.7 thousand contributors and over 30K stargazers on GitHub.

According to...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}