Mastering Apache Spark

Gain expertise in processing and storing data by using advanced techniques with Apache Spark
Preview in Mapt

Mastering Apache Spark

Mike Frampton

1 customer reviews
Gain expertise in processing and storing data by using advanced techniques with Apache Spark
Mapt Subscription
FREE
$29.99/m after trial
eBook
$30.80
RRP $43.99
Save 29%
Print + eBook
$54.99
RRP $54.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$30.80
$54.99
$29.99 p/m after trial
RRP $43.99
RRP $54.99
Subscription
eBook
Print + eBook
Start 30 Day Trial

Frequently bought together


Mastering Apache Spark Book Cover
Mastering Apache Spark
$ 43.99
$ 30.80
Apache Camel Essentials Book Cover
Apache Camel Essentials
$ 19.99
$ 14.00
Buy 2 for $31.50
Save $32.48
Add to Cart

Book Details

ISBN 139781783987146
Paperback318 pages

Book Description

Apache Spark is an in-memory cluster based parallel processing system that provides a wide range of functionality like graph processing, machine learning, stream processing and SQL. It operates at unprecedented speeds, is easy to use and offers a rich set of data transformations.

This book aims to take your limited knowledge of Spark to the next level by teaching you how to expand Spark functionality. The book commences with an overview of the Spark eco-system. You will learn how to use MLlib to create a fully working neural net for handwriting recognition. You will then discover how stream processing can be tuned for optimal performance and to ensure parallel processing. The book extends to show how to incorporate H20 for machine learning, Titan for graph based storage, Databricks for cloud-based Spark. Intermediate Scala based code examples are provided for Apache Spark module processing in a CentOS Linux and Databricks cloud environment.

Table of Contents

Chapter 1: Apache Spark
Overview
Cluster design
Cluster management
Performance
Cloud
Summary
Chapter 2: Apache Spark MLlib
The environment configuration
Classification with Naïve Bayes
Clustering with K-Means
ANN – Artificial Neural Networks
Summary
Chapter 3: Apache Spark Streaming
Overview
Errors and recovery
Streaming sources
Summary
Chapter 4: Apache Spark SQL
The SQL context
Importing and saving data
DataFrames
Using SQL
User-defined functions
Using Hive
Summary
Chapter 5: Apache Spark GraphX
Overview
GraphX coding
Mazerunner for Neo4j
Summary
Chapter 6: Graph-based Storage
Titan
TinkerPop
Installing Titan
Titan with HBase
Titan with Cassandra
Accessing Titan with Spark
Summary
Chapter 7: Extending Spark with H2O
Overview
The processing environment
Installing H2O
The build environment
Architecture
Sourcing the data
Data Quality
Performance tuning
Deep learning
H2O Flow
Summary
Chapter 8: Spark Databricks
Overview
Installing Databricks
AWS billing
Databricks menus
Account management
Cluster management
Notebooks and folders
Jobs and libraries
Development environments
Databricks tables
The DbUtils package
Summary
Chapter 9: Databricks Visualization
Data visualization
REST interface
Moving data
Further reading
Summary

What You Will Learn

  • Extend the tools available for processing and storage
  • Examine clustering and classification using MLlib
  • Discover Spark stream processing via Flume, HDFS
  • Create a schema in Spark SQL, and learn how a Spark schema can be populated with data
  • Study Spark based graph processing using Spark GraphX
  • Combine Spark with H20 and deep learning and learn why it is useful
  • Evaluate how graph storage works with Apache Spark, Titan, HBase and Cassandra
  • Use Apache Spark in the cloud with Databricks and AWS

Authors

Table of Contents

Chapter 1: Apache Spark
Overview
Cluster design
Cluster management
Performance
Cloud
Summary
Chapter 2: Apache Spark MLlib
The environment configuration
Classification with Naïve Bayes
Clustering with K-Means
ANN – Artificial Neural Networks
Summary
Chapter 3: Apache Spark Streaming
Overview
Errors and recovery
Streaming sources
Summary
Chapter 4: Apache Spark SQL
The SQL context
Importing and saving data
DataFrames
Using SQL
User-defined functions
Using Hive
Summary
Chapter 5: Apache Spark GraphX
Overview
GraphX coding
Mazerunner for Neo4j
Summary
Chapter 6: Graph-based Storage
Titan
TinkerPop
Installing Titan
Titan with HBase
Titan with Cassandra
Accessing Titan with Spark
Summary
Chapter 7: Extending Spark with H2O
Overview
The processing environment
Installing H2O
The build environment
Architecture
Sourcing the data
Data Quality
Performance tuning
Deep learning
H2O Flow
Summary
Chapter 8: Spark Databricks
Overview
Installing Databricks
AWS billing
Databricks menus
Account management
Cluster management
Notebooks and folders
Jobs and libraries
Development environments
Databricks tables
The DbUtils package
Summary
Chapter 9: Databricks Visualization
Data visualization
REST interface
Moving data
Further reading
Summary

Book Details

ISBN 139781783987146
Paperback318 pages
Read More
From 1 reviews

Read More Reviews

Recommended for You

Practical Machine Learning Book Cover
Practical Machine Learning
$ 37.99
$ 26.60
Fast Data Processing with Spark 2 - Third Edition Book Cover
Fast Data Processing with Spark 2 - Third Edition
$ 31.99
$ 22.40
Real-Time Big Data Analytics Book Cover
Real-Time Big Data Analytics
$ 35.99
$ 25.20
Apache Spark Machine Learning Blueprints Book Cover
Apache Spark Machine Learning Blueprints
$ 31.99
$ 22.40
Apache Spark 2 for Beginners Book Cover
Apache Spark 2 for Beginners
$ 31.99
$ 22.40
Big Data Analytics Book Cover
Big Data Analytics
$ 39.99
$ 28.00