Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Learning Jupyter 5 - Second Edition

You're reading from  Learning Jupyter 5 - Second Edition

Product type Book
Published in Aug 2018
Publisher
ISBN-13 9781789137408
Pages 282 pages
Edition 2nd Edition
Languages

Table of Contents (18) Chapters

Title Page
Packt Upsell
Contributors
Preface
Introduction to Jupyter Jupyter Python Scripting Jupyter R Scripting Jupyter Julia Scripting Jupyter Java Coding Jupyter JavaScript Coding Jupyter Scala Jupyter and Big Data Interactive Widgets Sharing and Converting Jupyter Notebooks Multiuser Jupyter Notebooks What's Next? Other Books You May Enjoy Index

Apache Spark


One of the tools we will be using is Apache Spark. Spark is an open source toolset for cluster computing. While we will not be using a cluster, typical usage for Spark is a larger set of machines or clusters that operate in parallel to analyze a big dataset. Installation instructions are available at https://www.dataquest.io/blog/pyspark-installation-guide.

Installing Spark on macOS

Up-to-date instructions for installing Spark are available at https://medium.freecodecamp.org/installing-scala-and-apache-spark-on-mac-os-837ae57d283f. The main steps are:

  1.  Get Homebrew from http://brew.sh. If you are doing software development on macOS, you will likely already have Homebrew.
  2. Install xcode-select: xcode-selectis used for different languages. For Spark we use Java, Scala and, of course, Spark as follows:
xcode-select -install

Again, it is likely that you will already have this for other software development tasks.

  1.  Use Homebrew to install Java:
brew cask install java
  1. Use Homebrew to install...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}