Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Apache Mahout Essentials

You're reading from  Apache Mahout Essentials

Product type Book
Published in Jun 2015
Publisher
ISBN-13 9781783554997
Pages 164 pages
Edition 1st Edition
Languages
Author (1):
Jayani Withanawasam Jayani Withanawasam
Profile icon Jayani Withanawasam

Monitoring Hadoop


Apache Hadoop daemons can be monitored using different mechanisms.

Commands/scripts

The running JVMs related to Hadoop can be displayed using the following command (use the correct Java installation location):

/usr/lib/jvm/java-7-oracle/bin/jps

The outcome of the preceding command is given in the following figure:

Data nodes

Active data nodes in the cluster can be displayed using the following command:

[Hadoop installation directory]/bin/hdfs dfsadmin –report

The outcome of the preceding command for a cluster with two data nodes is shown in the following figure:

Node managers

Active node managers can be monitored using the following command:

 [Hadoop installation directory]/bin /yarn node –list

The outcome of the preceding command for a cluster with two node managers is shown in the following figure:

Web UIs

Apache Hadoop has provided Web UIs to monitor MapReduce job processing details.

As shown in the following figure, NameNode operations in HDFS can be monitored at http://localhost...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}