Monitoring Hadoop

Get to grips with the intricacies of Hadoop monitoring using the power of Ganglia and Nagios
Preview in Mapt
Code Files

Monitoring Hadoop

Gurmukh Singh

Get to grips with the intricacies of Hadoop monitoring using the power of Ganglia and Nagios
Mapt Subscription
FREE
$29.99/m after trial
eBook
$16.80
RRP $23.99
Save 29%
Print + eBook
$29.99
RRP $29.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$16.80
$29.99
$29.99p/m after trial
RRP $23.99
RRP $29.99
Subscription
eBook
Print + eBook
Start 30 Day Trial

Frequently bought together


Monitoring Hadoop Book Cover
Monitoring Hadoop
$ 23.99
$ 16.80
Hadoop: Data Processing and Modelling Book Cover
Hadoop: Data Processing and Modelling
$ 69.99
$ 49.00
Buy 2 for $34.30
Save $59.68
Add to Cart
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 

Book Details

ISBN 139781783281558
Paperback100 pages

Book Description

With the exponential growth of data and many enterprises crunching more and more data, Hadoop as a data platform has gained a lot of popularity. The Hadoop platform needs to be monitored with respect to how it works and functions. There is an ever-increasing need to keep the Hadoop platform clean and healthy.

This book will help you to integrate Hadoop and Nagios in a seamless and easy way. At the start, the book covers the basics of operating system logging and monitoring. Getting to grips with the characteristics of Hadoop monitoring, metrics, and log collection will help Hadoop users, especially Hadoop administrators, diagnose and troubleshoot clusters better. In essence, the book teaches you how to set up an all-inclusive and robust monitoring system for the Hadoop platform. The book also serves as a quick reference to the various metrics available in Hadoop.

Concluding with the visualization of Hadoop metrics, you will get acquainted with the workings of Hadoop in a short span of time with the help of step-by-step instructions in each chapter.

Table of Contents

Chapter 1: Introduction to Monitoring
The need for monitoring
The monitoring tools available in the market
System logging
Summary
Chapter 2: Hadoop Daemons and Services
Hadoop daemons
YARN framework
Summary
Chapter 3: Hadoop Logging
The need for logging events
System logging
Logging levels
Logging in Hadoop
Summary
Chapter 4: HDFS Checks
HDFS overview
Nagios master configuration
The Nagios client configuration
Summary
Chapter 5: MapReduce Checks
MapReduce overview
MapReduce control commands
MapReduce health checks
Nagios master configuration
Nagios client configuration
Summary
Chapter 6: Hadoop Metrics and Visualization Using Ganglia
Hadoop metrics
Metrics contexts
Metrics system design
Metrics configuration
Configuring Metrics2
Exploring the metrics contexts
Hadoop Ganglia integration
Hadoop configuration
Ganglia graphs
Metrics APIs
Summary
Chapter 7: Hive, HBase, and Monitoring Best Practices
Hive monitoring
Hive metrics
HBase Nagios monitoring
HBase metrics
Monitoring best practices
The Filter class
Nagios and Ganglia best practices
Summary

What You Will Learn

  • Install Nagios and Ganglia and understand logging at the operating system level
  • Create and configure Nagios nodes for monitoring with custom checks
  • Monitor Hadoop daemons such as NameNode, DataNode, JobTracker, and so on
  • Configure logs for various daemons and set up audits for the options done on the cluster
  • Track important parameters for the File System, MapReduce, and other counters
  • Set up Nagios master and client nodes with checks for the system and applications running on it
  • Configure the Hadoop metrics collection and visualize it for nontechnical users
  • Understand the communication between different daemons and protocols and the ports they use

Authors

Table of Contents

Chapter 1: Introduction to Monitoring
The need for monitoring
The monitoring tools available in the market
System logging
Summary
Chapter 2: Hadoop Daemons and Services
Hadoop daemons
YARN framework
Summary
Chapter 3: Hadoop Logging
The need for logging events
System logging
Logging levels
Logging in Hadoop
Summary
Chapter 4: HDFS Checks
HDFS overview
Nagios master configuration
The Nagios client configuration
Summary
Chapter 5: MapReduce Checks
MapReduce overview
MapReduce control commands
MapReduce health checks
Nagios master configuration
Nagios client configuration
Summary
Chapter 6: Hadoop Metrics and Visualization Using Ganglia
Hadoop metrics
Metrics contexts
Metrics system design
Metrics configuration
Configuring Metrics2
Exploring the metrics contexts
Hadoop Ganglia integration
Hadoop configuration
Ganglia graphs
Metrics APIs
Summary
Chapter 7: Hive, HBase, and Monitoring Best Practices
Hive monitoring
Hive metrics
HBase Nagios monitoring
HBase metrics
Monitoring best practices
The Filter class
Nagios and Ganglia best practices
Summary

Book Details

ISBN 139781783281558
Paperback100 pages
Read More

Read More Reviews

Recommended for You

Big Data Analytics with R and Hadoop Book Cover
Big Data Analytics with R and Hadoop
$ 29.99
$ 21.00
Learning Hadoop 2 Book Cover
Learning Hadoop 2
$ 29.99
$ 21.00
Learning Docker Book Cover
Learning Docker
$ 39.99
$ 8.00
Hadoop Operations and Cluster Management Cookbook Book Cover
Hadoop Operations and Cluster Management Cookbook
$ 29.99
$ 21.00
Mastering Hadoop Book Cover
Mastering Hadoop
$ 29.99
$ 6.00
Cloudera Administration Handbook Book Cover
Cloudera Administration Handbook
$ 32.99
$ 23.10