Reader small image

You're reading from  Monitoring Hadoop

Product typeBook
Published inApr 2015
Publisher
ISBN-139781783281558
Edition1st Edition
Tools
Right arrow
Author (1)
Aman Singh
Aman Singh
author image
Aman Singh

Gurmukh Singh is a seasoned technology professional with 14+ years of industry experience in infrastructure design, distributed systems, performance optimization, and networks. He has worked in big data domain for the last 5 years and provides consultancy and training on various technologies. He has worked with companies such as HP, JP Morgan, and Yahoo. He has authored Monitoring Hadoop by Packt Publishing
Read more about Aman Singh

Right arrow

Exploring the metrics contexts


Till now, we have seen that there are various metrics contexts such as JVM, DFS, and RPC. Let's look at them and explore some of the examples, depicting what each context looks like and what it logs:

  • JVM context: The JVM context contains stats about JVM memory, threads, heap memory, and so on:

    jvm.metrics: hostName=dn1.cluster1.com, processName=DataNode, sessionId=,logError=0,logFatal=0,logInfo=159,logWarn=0, memHeapCommittedM=9.4,memHeapUsedM=12.63,memNonHeapCommittedM=28.75,memNonHeapUsedM=19.7356,threadsBlocked=0, threadsNew=0, threadsRunnable=3, threadsTerminated=0, threadsTimedWaiting=2, threadsWaiting=1
  • DFS context: The DFS context stats talk about the namenode files, capacity, blocks, and so on:

    dfs.FSNamesystem: hostName=nn1.cluster1.com, sessionId=, BlocksTotal=440, CapacityRemainingGB=100, CapacityTotalGB=254, CapacityUsedGB=0, FilesTotal=160, PendingReplicationBlocks=0, ScheduledReplicationBlocks=0, TotalLoad=1, UnderReplicatedBlocks=20
  • Mapred context...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Monitoring Hadoop
Published in: Apr 2015Publisher: ISBN-13: 9781783281558

Author (1)

author image
Aman Singh

Gurmukh Singh is a seasoned technology professional with 14+ years of industry experience in infrastructure design, distributed systems, performance optimization, and networks. He has worked in big data domain for the last 5 years and provides consultancy and training on various technologies. He has worked with companies such as HP, JP Morgan, and Yahoo. He has authored Monitoring Hadoop by Packt Publishing
Read more about Aman Singh