Raspberry Pi Super Cluster

As a Raspberry Pi enthusiast have you ever considered increasing their performance with parallel computing? Discover just how easy it can be with the right help – this guide takes you through the process from start to finish.

Raspberry Pi Super Cluster

Progressing
Andrew K. Dennis

As a Raspberry Pi enthusiast have you ever considered increasing their performance with parallel computing? Discover just how easy it can be with the right help – this guide takes you through the process from start to finish.
$20.99
$34.99
RRP $20.99
RRP $34.99
eBook
Print + eBook
$12.99 p/month

Get Access

Get Unlimited Access to every Packt eBook and Video course

Enjoy full and instant access to over 3000 books and videos – you’ll find everything you need to stay ahead of the curve and make sure you can always get the job done.

Book Details

ISBN 139781783286195
Paperback126 pages

About This Book

  • Learn about parallel computing by building your own system using Raspberry Pi
  • Build a two-node parallel computing cluster
  • Integrate Raspberry Pi with Hadoop to build your own super cluster

Who This Book Is For

Raspberry Pi Super Cluster is an introductory guide for those interested in experimenting with parallel computing at home. Aimed at Raspberry Pi enthusiasts, this book is a primer for getting your first cluster up and running.

Basic knowledge of C or Java would be helpful but no prior knowledge of parallel computing is necessary.

Table of Contents

Chapter 1: Clusters, Parallel Computing, and Raspberry Pi – A Brief Background
A very short history of parallel computing
Raspberry Pi and parallel computing
Summary
Chapter 2: Setting Up your Raspberry Pi Software and Hardware for Parallel Computing
Setting up our work environment
Future expansion and a scalable setup
Completing the initial setup
Using an SD card as our Raspberry Pi's storage device
BerryBoot version 2
Starting up the Raspberry Pi
Wrapping up
Summary
Chapter 3: Parallel Computing – MPI on the Raspberry Pi
MPI – Message Passing Interface
MPI implementations – MPICH and OpenMPI
Creating an environment and downloading MPICH
Writing an MPI-based application
Summary
Chapter 4: Hadoop – Distributed Applications on the Raspberry Pi
A brief introduction to Apache Hadoop
Installing Java
Installing Apache Hadoop
Summary
Chapter 5: MapReduce Applications with Hadoop and Java
MapReduce
MapReduce in Hadoop
The WordCount MapReduce program
Testing our application
Summary
Chapter 6: Calculate Pi with Hadoop and MPI
Monte Carlo simulators
A Hadoop application to calculate Pi
Pi with C language and MPI
Summary
Chapter 7: Going Further
Booting from an external USB HDD
Building a Lego enclosure
Experimenting with MPI and Fortran
Power for multiple devices
Summary

What You Will Learn

  • Discover how to set up the hardware to build your parallel computing cluster
  • Set up your Raspberry Pi computers and install an operating system
  • Network your two Raspberry Pi’s together
  • Gain an understanding of MPI through practical examples
  • Learn how to work with MPICH to write parallel applications
  • Install Hadoop and experiment with processing text files
  • Get acquainted with MapReduce, the paradigm at the heart of Hadoop

In Detail

A cluster is a type of parallel/distributed processing system which consists of a collection of interconnected stand-alone computers cooperatively working together. Using Raspberry Pi computers, you can build a two-node parallel computing cluster which enhances performance and availability.

This practical, example-oriented guide will teach you how to set up the hardware and operating systems of multiple Raspberry Pi computers to create your own cluster. It will then navigate you through how to install the necessary software to write your own programs such as Hadoop and MPICH before moving on to cover topics such as MapReduce. Throughout this book, you will explore the technology with the help of practical examples and tutorials to help you learn quickly and efficiently.

Starting from a pile of hardware, with this book, you will be guided through exciting tutorials that will help you turn your hardware into your own super-computing cluster. You’ll start out by learning how to set up your Raspberry Pi cluster’s hardware. Following this, you will be taken through how to install the operating system, and you will also be given a taste of what parallel computing is about. With your Raspberry Pi cluster successfully set up, you will then install software such as MPI and Hadoop. Having reviewed some examples and written some programs that explore these two technologies, you will then wrap up with some fun ancillary projects. Finally, you will be provided with useful links to help take your projects to the next step.

Authors

Table of Contents

Chapter 1: Clusters, Parallel Computing, and Raspberry Pi – A Brief Background
A very short history of parallel computing
Raspberry Pi and parallel computing
Summary
Chapter 2: Setting Up your Raspberry Pi Software and Hardware for Parallel Computing
Setting up our work environment
Future expansion and a scalable setup
Completing the initial setup
Using an SD card as our Raspberry Pi's storage device
BerryBoot version 2
Starting up the Raspberry Pi
Wrapping up
Summary
Chapter 3: Parallel Computing – MPI on the Raspberry Pi
MPI – Message Passing Interface
MPI implementations – MPICH and OpenMPI
Creating an environment and downloading MPICH
Writing an MPI-based application
Summary
Chapter 4: Hadoop – Distributed Applications on the Raspberry Pi
A brief introduction to Apache Hadoop
Installing Java
Installing Apache Hadoop
Summary
Chapter 5: MapReduce Applications with Hadoop and Java
MapReduce
MapReduce in Hadoop
The WordCount MapReduce program
Testing our application
Summary
Chapter 6: Calculate Pi with Hadoop and MPI
Monte Carlo simulators
A Hadoop application to calculate Pi
Pi with C language and MPI
Summary
Chapter 7: Going Further
Booting from an external USB HDD
Building a Lego enclosure
Experimenting with MPI and Fortran
Power for multiple devices
Summary

Book Details

ISBN 139781783286195
Paperback126 pages
Read More