Monitoring Hadoop

Get to grips with the intricacies of Hadoop monitoring using the power of Ganglia and Nagios

Monitoring Hadoop

This ebook is included in a Mapt subscription
Gurmukh Singh

Get to grips with the intricacies of Hadoop monitoring using the power of Ganglia and Nagios
$0.00
$23.99
$29.99
$29.99p/m after trial
RRP $23.99
RRP $29.99
Subscription
eBook
Print + eBook
Start 30 Day Trial
Subscribe and access every Packt eBook & Video.
 
  • 4,000+ eBooks & Videos
  • 40+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 
Code Files
Preview in Mapt

Book Details

ISBN 139781783281558
Paperback100 pages

Book Description

With the exponential growth of data and many enterprises crunching more and more data, Hadoop as a data platform has gained a lot of popularity. The Hadoop platform needs to be monitored with respect to how it works and functions. There is an ever-increasing need to keep the Hadoop platform clean and healthy.

This book will help you to integrate Hadoop and Nagios in a seamless and easy way. At the start, the book covers the basics of operating system logging and monitoring. Getting to grips with the characteristics of Hadoop monitoring, metrics, and log collection will help Hadoop users, especially Hadoop administrators, diagnose and troubleshoot clusters better. In essence, the book teaches you how to set up an all-inclusive and robust monitoring system for the Hadoop platform. The book also serves as a quick reference to the various metrics available in Hadoop.

Concluding with the visualization of Hadoop metrics, you will get acquainted with the workings of Hadoop in a short span of time with the help of step-by-step instructions in each chapter.

Table of Contents

Chapter 1: Introduction to Monitoring
The need for monitoring
The monitoring tools available in the market
System logging
Summary
Chapter 2: Hadoop Daemons and Services
Hadoop daemons
YARN framework
Summary
Chapter 3: Hadoop Logging
The need for logging events
System logging
Logging levels
Logging in Hadoop
Summary
Chapter 4: HDFS Checks
HDFS overview
Nagios master configuration
The Nagios client configuration
Summary
Chapter 5: MapReduce Checks
MapReduce overview
MapReduce control commands
MapReduce health checks
Nagios master configuration
Nagios client configuration
Summary
Chapter 6: Hadoop Metrics and Visualization Using Ganglia
Hadoop metrics
Metrics contexts
Metrics system design
Metrics configuration
Configuring Metrics2
Exploring the metrics contexts
Hadoop Ganglia integration
Hadoop configuration
Ganglia graphs
Metrics APIs
Summary
Chapter 7: Hive, HBase, and Monitoring Best Practices
Hive monitoring
Hive metrics
HBase Nagios monitoring
HBase metrics
Monitoring best practices
The Filter class
Nagios and Ganglia best practices
Summary

What You Will Learn

  • Install Nagios and Ganglia and understand logging at the operating system level
  • Create and configure Nagios nodes for monitoring with custom checks
  • Monitor Hadoop daemons such as NameNode, DataNode, JobTracker, and so on
  • Configure logs for various daemons and set up audits for the options done on the cluster
  • Track important parameters for the File System, MapReduce, and other counters
  • Set up Nagios master and client nodes with checks for the system and applications running on it
  • Configure the Hadoop metrics collection and visualize it for nontechnical users
  • Understand the communication between different daemons and protocols and the ports they use

Authors

Table of Contents

Chapter 1: Introduction to Monitoring
The need for monitoring
The monitoring tools available in the market
System logging
Summary
Chapter 2: Hadoop Daemons and Services
Hadoop daemons
YARN framework
Summary
Chapter 3: Hadoop Logging
The need for logging events
System logging
Logging levels
Logging in Hadoop
Summary
Chapter 4: HDFS Checks
HDFS overview
Nagios master configuration
The Nagios client configuration
Summary
Chapter 5: MapReduce Checks
MapReduce overview
MapReduce control commands
MapReduce health checks
Nagios master configuration
Nagios client configuration
Summary
Chapter 6: Hadoop Metrics and Visualization Using Ganglia
Hadoop metrics
Metrics contexts
Metrics system design
Metrics configuration
Configuring Metrics2
Exploring the metrics contexts
Hadoop Ganglia integration
Hadoop configuration
Ganglia graphs
Metrics APIs
Summary
Chapter 7: Hive, HBase, and Monitoring Best Practices
Hive monitoring
Hive metrics
HBase Nagios monitoring
HBase metrics
Monitoring best practices
The Filter class
Nagios and Ganglia best practices
Summary

Book Details

ISBN 139781783281558
Paperback100 pages
Read More

Read More Reviews