Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Fast Data Processing Systems with SMACK Stack

You're reading from  Fast Data Processing Systems with SMACK Stack

Product type Book
Published in Dec 2016
Publisher Packt
ISBN-13 9781786467201
Pages 376 pages
Edition 1st Edition
Languages
Author (1):
Raúl Estrada Raúl Estrada
Profile icon Raúl Estrada

Table of Contents (15) Chapters

Fast Data Processing Systems with SMACK Stack
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
1. An Introduction to SMACK 2. The Model - Scala and Akka 3. The Engine - Apache Spark 4. The Storage - Apache Cassandra 5. The Broker - Apache Kafka 6. The Manager - Apache Mesos 7. Study Case 1 - Spark and Cassandra 8. Study Case 2 - Connectors 9. Study Case 3 - Mesos and Docker

Singularity


Singularity key points are as follows:

  • Acts as an API and a web application
  • Conceived at HubSpot and later open sourced under Apache license
  • Used to launch and schedule long-running Mesos processes, scheduled jobs, and tasks
  • All its components can be considered as a PaaS to end users
  • Non-experimented users can use it to deploy tasks on Mesos without so much knowledge
  • Shares Mesos features such as fault tolerance, scalability, and resource allocation
  • Can run a task scheduler for other Mesos frameworks

Singularity installation

To install Singularity we need to have Docker installed, to do it follow the steps at:

https://docs.docker.com

Once installed, clone the singularity repository with this command:

$ git clone https://github.com/HubSpot/Singularity 

Change the singularity directory:

$ cd Singularity 

Now, use Docker Compose pull and up commands to test Singularity.

These commands set up the following in the container:

  • Mesos master and slave
  • Zookeeper
  • Singularity
  • Baragon service and Baragon...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}