Reader small image

You're reading from  Mastering Mesos

Product typeBook
Published inMay 2016
PublisherPackt
ISBN-139781785886249
Edition1st Edition
Tools
Right arrow
Authors (2):
Dipa Dubhashi
Dipa Dubhashi
author image
Dipa Dubhashi

Dipa Dubhashi is an alumnus of the prestigious Indian Institute of Technology and heads product management at Sigmoid. His prior experience includes consulting with ZS Associates besides founding his own start-up. Dipa specializes in envisioning enterprise big data products, developing their roadmaps, and managing their development to solve customer use cases across multiple industries. He advises several leading start-ups as well as Fortune 500 companies about architecting and implementing their next-generation big data solutions. Dipa has also developed a course on Apache Spark for a leading online education portal and is a regular speaker at big data meetups and conferences.
Read more about Dipa Dubhashi

Akhil Das
Akhil Das
author image
Akhil Das

Akhil Das is a senior software developer at Sigmoid primarily focusing on distributed computing, real-time analytics, performance optimization, and application scaling problems using a wide variety of technologies such as Apache Spark and Mesos, among others. He contributes actively to the Apache Spark project and is a regular speaker at big data conferences and meetups, MesosCon 2015 being the most recent one.
Read more about Akhil Das

View More author details
Right arrow

Building a custom framework on Mesos


As we already know, a Mesos framework is an application running on Mesos. In this module, we will see how we can create our own Mesos framework. For the sake of simplicity, we will create a simple Java application to calculate the value of pi. A Mesos framework consists of the following three components:

  • Driver: This is the piece of code that submits tasks to the framework

  • Executor: This is the piece of code that is launched on the Mesos slave nodes to run the framework's tasks

  • Scheduler: This is the piece of code that registers with the master, asks for resources from it, and runs tasks on the executor

Now, let's take a look at how we can develop each of these components to build a custom Mesos framework in the following sections.

Driver implementation

The driver program is the one that creates the executor information. The executor information consists of an executorID being a String value and a command that is executed through the Linux /bin/sh-c command...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Mastering Mesos
Published in: May 2016Publisher: PacktISBN-13: 9781785886249

Authors (2)

author image
Dipa Dubhashi

Dipa Dubhashi is an alumnus of the prestigious Indian Institute of Technology and heads product management at Sigmoid. His prior experience includes consulting with ZS Associates besides founding his own start-up. Dipa specializes in envisioning enterprise big data products, developing their roadmaps, and managing their development to solve customer use cases across multiple industries. He advises several leading start-ups as well as Fortune 500 companies about architecting and implementing their next-generation big data solutions. Dipa has also developed a course on Apache Spark for a leading online education portal and is a regular speaker at big data meetups and conferences.
Read more about Dipa Dubhashi

author image
Akhil Das

Akhil Das is a senior software developer at Sigmoid primarily focusing on distributed computing, real-time analytics, performance optimization, and application scaling problems using a wide variety of technologies such as Apache Spark and Mesos, among others. He contributes actively to the Apache Spark project and is a regular speaker at big data conferences and meetups, MesosCon 2015 being the most recent one.
Read more about Akhil Das