Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Monitoring Hadoop

You're reading from  Monitoring Hadoop

Product type Book
Published in Apr 2015
Publisher
ISBN-13 9781783281558
Pages 100 pages
Edition 1st Edition
Languages
Author (1):
Aman Singh Aman Singh
Profile icon Aman Singh

MapReduce health checks


There are many factors that impact the performance of a job or application submitted to the cluster. The important checks, which can help narrow down the bottlenecks and help in improving the performance, can be many, but the few important ones are as follows:

  • Health of JobTracker or the RM

  • Backlog of tasks in the cluster; make sure that the number of tasks does not cross the upper limit of the maximum tasks supported in the cluster

  • Localities of the tasks run to make sure that there is minimal across-rack traffic

  • Health of TaskTracker and other components like NodeManager depending upon the MR version

The above checks are very well-documented and talked about at the Cloudera website. Please read them for further understanding.

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}