Apache Spark with Scala – Hands-On with Big Data! [Video]
Video
Video
$99.99
Subscription
$15.99
$10 p/m for three months
What do you get with a Packt Subscription?
This book & 7000+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with a Packt Subscription?
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with Video + Subscription?
Download this video in MP4 format, plus a monthly download credit
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with a Packt Subscription?
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with eBook?
What do I get with Print?
Get a paperback copy of the book delivered to your specified Address*
Download this book in EPUB and PDF formats
Access this title in our online reader
DRM FREE - Read whenever, wherever and however you want
Online reader with customised display settings for better reading experience
What do I get with Print?
What do you get with video?
What do you get with video?
What do you get with Audiobook?
What do you get with Exam Trainer?
Video
$99.99
Subscription
$15.99
$10 p/m for three months
What do you get with a Packt Subscription?
This book & 7000+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with a Packt Subscription?
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with Video + Subscription?
Download this video in MP4 format, plus a monthly download credit
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with a Packt Subscription?
This book & 6500+ ebooks & video courses on 1000+ technologies
60+ curated reading lists for various learning paths
50+ new titles added every month on new and emerging tech
Early Access to eBooks as they are being written
Personalised content suggestions
Customised display settings for better reading experience
50+ new titles added every month on new and emerging tech
Playlists, Notes and Bookmarks to easily manage your learning
Mobile App with offline access
What do you get with eBook?
Download this book in EPUB and PDF formats
Access this title in our online reader
DRM FREE - Read whenever, wherever and however you want
Online reader with customised display settings for better reading experience
What do I get with Print?
Get a paperback copy of the book delivered to your specified Address*
Download this book in EPUB and PDF formats
Access this title in our online reader
DRM FREE - Read whenever, wherever and however you want
Online reader with customised display settings for better reading experience
What do I get with Print?
Get a paperback copy of the book delivered to your specified Address*
Access this title in our online reader
Online reader with customised display settings for better reading experience
What do you get with video?
Download this video in MP4 format
Access this title in our online reader
DRM FREE - Watch whenever, wherever and however you want
Online reader with customised display settings for better learning experience
What do you get with video?
Stream this video
Access this title in our online reader
DRM FREE - Watch whenever, wherever and however you want
Online reader with customised display settings for better learning experience
What do you get with Audiobook?
Download a zip folder consisting of audio files (in MP3 Format) along with supplementary PDF
What do you get with Exam Trainer?
Flashcards, Mock exams, Exam Tips, Practice Questions
Access these resources with our interactive certification platform
Mobile compatible-Practice whenever, wherever, however you want
-
Free ChapterGetting Started
-
Scala Crash Course (Optional)
-
Using Resilient Distributed Datasets (RDDs)
- The Resilient Distributed Dataset
- Ratings Histogram Example
- Spark Internals
- Key / Value RDDs, and the Average Friends by Age Example
- (Activity) Running the Average Friends by Age Example
- Filtering RDDs, and the Minimum Temperature by Location Example
- (Activity) Running the Minimum Temperature Example, and Modifying It for Maximum
- (Activity) Counting Word Occurrences Using Flatmap()
- (Activity) Improving the Word Count Script with Regular Expressions
- (Activity) Sorting the Word Count Results
- (Exercise) Find the Total Amount Spent by Customer
- (Exercise) Check Your Results and Sort Them by Total Amount Spent
- Check Your Results and Implementation Against Mine
-
SparkSQL, DataFrames, and DataSets
- Introduction to SparkSQL
- (Activity) Using SparkSQL
- (Activity) Using DataSets
- (Exercise) Implement the Friends by Age Example Using DataSets
- Exercise Solution: Friends by Age, with DataSets
- (Activity) Word Count Example Using DataSets
- (Activity) Revisiting the Minimum Temperature Example, with DataSets
- (Exercise) Implement the Total Spent by Customer Problem with DataSets
- Exercise Solution: Total Spent by Customer with DataSets
-
Advanced Examples of Spark Programs
- (Activity) Find the Most Popular Movie
- (Activity) Use Broadcast Variables to Display Movie Names
- (Activity) Find the Most Popular Superhero in a Social Graph
- (Exercise) Find the Most Obscure Superheroes
- Exercise Solution: Find the Most Obscure Superheroes
- Superhero Degrees of Separation: Introducing Breadth-First Search
- Superhero Degrees of Separation: Accumulators, and Implementing BFS in Spark
- (Activity) Superhero Degrees of Separation: Review the Code and Run It!
- Item-Based Collaborative Filtering in Spark, cache(), and persist()
- (Activity) Running the Similar Movies Script Using Spark's Cluster Manager
- (Exercise) Improve the Quality of Similar Movies
-
Running Spark on a Cluster
- (Activity) Using spark-submit to Run Spark Driver Scripts
- (Activity) Packaging Driver Scripts with SBT
- (Exercise) Package a Script with SBT and Run It Locally with spark-submit
- Exercise Solution: Using SBT and spark-submit
- Introducing Amazon Elastic MapReduce
- Creating Similar Movies from One Million Ratings on EMR
- Partitioning
- Best Practices for Running on a Cluster
- Troubleshooting and Managing Dependencies
-
Machine Learning with Spark ML
-
Introduction to Spark Streaming
- The DStream API for Spark Streaming
- (Activity) Real-Time Monitoring of the Most Popular Hashtags on Twitter
- Structured Streaming
- (Activity) Using Structured Streaming for Real-Time Log Analysis
- (Exercise) Windowed Operations with Structured Streaming
- Exercise Solution: Top URLs in a 30-Second Window
-
Introduction to GraphX
-
You Made It! Where to Go from Here
About this
video
“Big data” analysis is a hot and highly valuable skill—and this course will teach you the hottest technology in big data: Apache Spark. Employers including Amazon, eBay, NASA JPL, and Yahoo all use Spark to quickly extract meaning from massive datasets across a fault-tolerant Hadoop cluster. You will learn those same techniques using your own Windows system right at home. It is easier than you think, and you will learn from an ex-engineer and senior manager from Amazon and IMDb.
In this course, you will learn the concepts of Spark’s Resilient Distributed Datasets, DataFrames, and datasets. We will also cover a crash course in the Scala programming language that will help you with the course. You will learn how to develop and run Spark jobs quickly using Scala, IntelliJ, and SBT. You will learn how to translate complex analysis problems into iterative or multi-stage Spark scripts. You will learn how to scale up to larger datasets using Amazon’s Elastic MapReduce service and understand how Hadoop YARN distributes Spark across computing clusters. We will also be practicing using other Spark technologies, such as Spark SQL, DataFrames, DataSets, Spark Streaming, Machine Learning, and GraphX.
By the end of this course, you will be running code that analyzes gigabytes worth of information—in the cloud—in a matter of minutes.
All the codes and supporting files for this course are available at https://github.com/PacktPublishing/Apache-Spark-with-Scala---Hands-On-with-Big-Data-
- Publication date:
- September 2016
- Publisher
- Packt
- Duration
- 8 hours 55 minutes
- ISBN
- 9781787129849
Latest Reviews
(1 reviews total)