Mastering Mesos

The ultimate guide to managing, building, and deploying large-scale clusters with Apache Mesos

Mastering Mesos

Dipa Dubhashi, Akhil Das

2 customer reviews
The ultimate guide to managing, building, and deploying large-scale clusters with Apache Mesos
Mapt Subscription
FREE
$29.99/m after trial
eBook
$30.80
RRP $43.99
Print + eBook
$54.99
RRP $54.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$30.80
$54.99
$29.99p/m after trial
RRP $43.99
RRP $54.99
Subscription
eBook
Print + eBook
Start 30 Day Trial
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 
Preview in Mapt

Book Details

ISBN 139781785886249
Paperback352 pages

Book Description

Apache Mesos is open source cluster management software that provides efficient resource isolations and resource sharing distributed applications or frameworks.

This book will take you on a journey to enhance your knowledge from amateur to master level, showing you how to improve the efficiency, management, and development of Mesos clusters. The architecture is quite complex and this book will explore the difficulties and complexities of working with Mesos.

We begin by introducing Mesos, explaining its architecture and functionality. Next, we provide a comprehensive overview of Mesos features and advanced topics such as high availability, fault tolerance, scaling, and efficiency. Furthermore, you will learn to set up multi-node Mesos clusters on private and public clouds.

We will also introduce several Mesos-based scheduling and management frameworks or applications to enable the easy deployment, discovery, load balancing, and failure handling of long-running services. Next, you will find out how a Mesos cluster can be easily set up and monitored using the standard deployment and configuration management tools.

This advanced guide will show you how to deploy important big data processing frameworks such as Hadoop, Spark, and Storm on Mesos and big data storage frameworks such as Cassandra, Elasticsearch, and Kafka.

Table of Contents

Chapter 1: Introducing Mesos
Introduction to the datacenter OS and architecture of Mesos
The architecture of Mesos
Introduction to frameworks
The attributes and resources of Mesos
Two-level scheduling
Resource allocation
Resource isolation
Monitoring in Mesos
The Mesos API
Mesos in production
Summary
Chapter 2: Mesos Internals
Scaling and efficiency
Reservation
Mesos modules
High availability and fault tolerance
Reconciliation
Persistent Volumes
Summary
Chapter 3: Getting Started with Mesos
Virtual Machine (VM) instances
Setting up a multi-node Mesos cluster on Amazon Web Services (AWS)
Setting up a multi-node Mesos cluster on Google Compute Engine (GCE)
Setting up a multi-node Mesos cluster on Microsoft Azure
Setting up a multi-node Mesos cluster on your private datacenter
Debugging and troubleshooting
Summary
Chapter 4: Service Scheduling and Management Frameworks
Using Marathon to launch and manage long-running applications on Mesos
Multi-node Marathon cluster setup
Chronos as a cluster scheduler
Chronos plus Marathon
Introduction to Apache Aurora
Introduction to Singularity
Service discovery using Marathoner
Service discovery using Consul
Load balancing with HAProxy
Bamboo - Automatically configuring HAProxy for Mesos plus Marathon
Introduction to Netflix Fenzo
Introduction to PaaSTA
A comparative analysis of different Scheduling/Management frameworks
Summary
Chapter 5: Mesos Cluster Deployment
Deploying and configuring a Mesos cluster using Ansible
Deploying and configuring Mesos cluster using Puppet
Deploying and configuring a Mesos cluster using SaltStack
Deploying and configuring a Mesos cluster using Chef
Deploying and configuring a Mesos cluster using Terraform
Deploying and configuring a Mesos cluster using Cloudformation
Creating test environments using Playa Mesos
Monitoring the Mesos cluster using Nagios
Monitoring the Mesos cluster using Satellite
Common deployment issues and solutions
Summary
Chapter 6: Mesos Frameworks
Introduction to Mesos frameworks
Frameworks – Authentication, authorization, and access control
The Mesos API
Building a custom framework on Mesos
Summary
Chapter 7: Mesos Containerizers
Containers
Docker
Mesos containerizer
Networking for Mesos-managed containers
Mesos Image Provisioner
Mesos fetcher
Deploying containerized apps using Docker and Mesos
Summary
Chapter 8: Mesos Big Data Frameworks
Hadoop on Mesos
Spark on Mesos
Storm on Mesos
Samza on Mesos
Summary
Chapter 9: Mesos Big Data Frameworks 2
Cassandra on Mesos
The Elasticsearch-Logstash-Kibana (ELK) stack on Mesos
Kafka on Mesos
Summary

What You Will Learn

  • Understand the Mesos architecture
  • Manually spin up a Mesos cluster on a distributed infrastructure
  • Deploy a multi-node Mesos cluster using your favorite DevOps
  • See the nuts and bolts of scheduling, service discovery, failure handling, security, monitoring, and debugging in an enterprise-grade, production cluster deployment
  • Use Mesos to deploy big data frameworks, containerized applications, or even custom build your own applications effortlessly

Authors

Table of Contents

Chapter 1: Introducing Mesos
Introduction to the datacenter OS and architecture of Mesos
The architecture of Mesos
Introduction to frameworks
The attributes and resources of Mesos
Two-level scheduling
Resource allocation
Resource isolation
Monitoring in Mesos
The Mesos API
Mesos in production
Summary
Chapter 2: Mesos Internals
Scaling and efficiency
Reservation
Mesos modules
High availability and fault tolerance
Reconciliation
Persistent Volumes
Summary
Chapter 3: Getting Started with Mesos
Virtual Machine (VM) instances
Setting up a multi-node Mesos cluster on Amazon Web Services (AWS)
Setting up a multi-node Mesos cluster on Google Compute Engine (GCE)
Setting up a multi-node Mesos cluster on Microsoft Azure
Setting up a multi-node Mesos cluster on your private datacenter
Debugging and troubleshooting
Summary
Chapter 4: Service Scheduling and Management Frameworks
Using Marathon to launch and manage long-running applications on Mesos
Multi-node Marathon cluster setup
Chronos as a cluster scheduler
Chronos plus Marathon
Introduction to Apache Aurora
Introduction to Singularity
Service discovery using Marathoner
Service discovery using Consul
Load balancing with HAProxy
Bamboo - Automatically configuring HAProxy for Mesos plus Marathon
Introduction to Netflix Fenzo
Introduction to PaaSTA
A comparative analysis of different Scheduling/Management frameworks
Summary
Chapter 5: Mesos Cluster Deployment
Deploying and configuring a Mesos cluster using Ansible
Deploying and configuring Mesos cluster using Puppet
Deploying and configuring a Mesos cluster using SaltStack
Deploying and configuring a Mesos cluster using Chef
Deploying and configuring a Mesos cluster using Terraform
Deploying and configuring a Mesos cluster using Cloudformation
Creating test environments using Playa Mesos
Monitoring the Mesos cluster using Nagios
Monitoring the Mesos cluster using Satellite
Common deployment issues and solutions
Summary
Chapter 6: Mesos Frameworks
Introduction to Mesos frameworks
Frameworks – Authentication, authorization, and access control
The Mesos API
Building a custom framework on Mesos
Summary
Chapter 7: Mesos Containerizers
Containers
Docker
Mesos containerizer
Networking for Mesos-managed containers
Mesos Image Provisioner
Mesos fetcher
Deploying containerized apps using Docker and Mesos
Summary
Chapter 8: Mesos Big Data Frameworks
Hadoop on Mesos
Spark on Mesos
Storm on Mesos
Samza on Mesos
Summary
Chapter 9: Mesos Big Data Frameworks 2
Cassandra on Mesos
The Elasticsearch-Logstash-Kibana (ELK) stack on Mesos
Kafka on Mesos
Summary

Book Details

ISBN 139781785886249
Paperback352 pages
Read More
From 2 reviews

Read More Reviews