Fast Data Processing with Spark - Second Edition

Perform real-time analytics using Spark in a fast, distributed, and scalable way
Preview in Mapt

Fast Data Processing with Spark - Second Edition

Krishna Sankar, Holden Karau

1 customer reviews
Perform real-time analytics using Spark in a fast, distributed, and scalable way
Mapt Subscription
FREE
$29.99/m after trial
eBook
$16.80
RRP $23.99
Save 29%
Print + eBook
$29.99
RRP $29.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$16.80
$29.99
$29.99p/m after trial
RRP $23.99
RRP $29.99
Subscription
eBook
Print + eBook
Start 30 Day Trial

Frequently bought together


Fast Data Processing with Spark - Second Edition Book Cover
Fast Data Processing with Spark - Second Edition
$ 23.99
$ 16.80
Fast Data Processing with Spark 2 - Third Edition Book Cover
Fast Data Processing with Spark 2 - Third Edition
$ 31.99
$ 22.40
Buy 2 for $34.30
Save $21.68
Add to Cart
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 

Book Details

ISBN 139781784392574
Paperback184 pages

Book Description

Spark is a framework used for writing fast, distributed programs. Spark solves similar problems as Hadoop MapReduce does, but with a fast in-memory approach and a clean functional style API. With its ability to integrate with Hadoop and built-in tools for interactive query analysis (Spark SQL), large-scale graph processing and analysis (GraphX), and real-time analysis (Spark Streaming), it can be interactively used to quickly process and query big datasets.

Fast Data Processing with Spark - Second Edition covers how to write distributed programs with Spark. The book will guide you through every step required to write effective distributed programs from setting up your cluster and interactively exploring the API to developing analytics applications and tuning them for your purposes.

Table of Contents

Chapter 1: Installing Spark and Setting up your Cluster
Directory organization and convention
Installing prebuilt distribution
Building Spark from source
Spark topology
A single machine
Running Spark on EC2
Deploying Spark with Chef (Opscode)
Deploying Spark on Mesos
Spark on YARN
Spark Standalone mode
Summary
Chapter 2: Using the Spark Shell
Loading a simple text file
Using the Spark shell to run logistic regression
Interactively loading data from S3
Summary
Chapter 3: Building and Running a Spark Application
Building your Spark project with sbt
Building your Spark job with Maven
Building your Spark job with something else
Summary
Chapter 4: Creating a SparkContext
Scala
Java
SparkContext – metadata
Shared Java and Scala APIs
Python
Summary
Chapter 5: Loading and Saving Data in Spark
RDDs
Loading data into an RDD
Saving your data
Summary
Chapter 6: Manipulating your RDD
Manipulating your RDD in Scala and Java
Manipulating your RDD in Python
Summary
Chapter 7: Spark SQL
The Spark SQL architecture
Summary
Chapter 8: Spark with Big Data
Parquet – an efficient and interoperable big data format
Querying Parquet files with Impala
HBase
Summary
Chapter 9: Machine Learning Using Spark MLlib
The Spark machine learning algorithm table
Spark MLlib examples
Summary
Chapter 10: Testing
Testing in Java and Scala
Testing in Python
Summary
Chapter 11: Tips and Tricks
Where to find logs
Concurrency limitations
Using Spark with other languages
A quick note on security
Community developed packages
Mailing lists
Summary

What You Will Learn

  • Install and set up Spark on your cluster
  • Prototype distributed applications with Spark's interactive shell
  • Learn different ways to interact with Spark's distributed representation of data (RDDs)
  • Query Spark with a SQL-like query syntax
  • Effectively test your distributed software
  • Recognize how Spark works with big data
  • Implement machine learning systems with highly scalable algorithms

Authors

Table of Contents

Chapter 1: Installing Spark and Setting up your Cluster
Directory organization and convention
Installing prebuilt distribution
Building Spark from source
Spark topology
A single machine
Running Spark on EC2
Deploying Spark with Chef (Opscode)
Deploying Spark on Mesos
Spark on YARN
Spark Standalone mode
Summary
Chapter 2: Using the Spark Shell
Loading a simple text file
Using the Spark shell to run logistic regression
Interactively loading data from S3
Summary
Chapter 3: Building and Running a Spark Application
Building your Spark project with sbt
Building your Spark job with Maven
Building your Spark job with something else
Summary
Chapter 4: Creating a SparkContext
Scala
Java
SparkContext – metadata
Shared Java and Scala APIs
Python
Summary
Chapter 5: Loading and Saving Data in Spark
RDDs
Loading data into an RDD
Saving your data
Summary
Chapter 6: Manipulating your RDD
Manipulating your RDD in Scala and Java
Manipulating your RDD in Python
Summary
Chapter 7: Spark SQL
The Spark SQL architecture
Summary
Chapter 8: Spark with Big Data
Parquet – an efficient and interoperable big data format
Querying Parquet files with Impala
HBase
Summary
Chapter 9: Machine Learning Using Spark MLlib
The Spark machine learning algorithm table
Spark MLlib examples
Summary
Chapter 10: Testing
Testing in Java and Scala
Testing in Python
Summary
Chapter 11: Tips and Tricks
Where to find logs
Concurrency limitations
Using Spark with other languages
A quick note on security
Community developed packages
Mailing lists
Summary

Book Details

ISBN 139781784392574
Paperback184 pages
Read More
From 1 reviews

Read More Reviews

Recommended for You

Machine Learning with Spark Book Cover
Machine Learning with Spark
$ 29.99
$ 3.00
Practical Data Science Cookbook Book Cover
Practical Data Science Cookbook
$ 29.99
$ 21.00
Python Machine Learning Book Cover
Python Machine Learning
$ 35.99
$ 25.20
Machine Learning with R Book Cover
Machine Learning with R
$ 32.99
$ 23.10
Big Data Analytics with R and Hadoop Book Cover
Big Data Analytics with R and Hadoop
$ 29.99
$ 21.00
Spark Cookbook Book Cover
Spark Cookbook
$ 35.99
$ 25.20