Reader small image

You're reading from  Monitoring Hadoop

Product typeBook
Published inApr 2015
Publisher
ISBN-139781783281558
Edition1st Edition
Tools
Right arrow
Author (1)
Aman Singh
Aman Singh
author image
Aman Singh

Gurmukh Singh is a seasoned technology professional with 14+ years of industry experience in infrastructure design, distributed systems, performance optimization, and networks. He has worked in big data domain for the last 5 years and provides consultancy and training on various technologies. He has worked with companies such as HP, JP Morgan, and Yahoo. He has authored Monitoring Hadoop by Packt Publishing
Read more about Aman Singh

Right arrow

The Filter class


To address the issue discussed above, Hadoop provides a filter class, which provides regular expressions to filter the metrics and make it more compact and meaningful as follows:

*.source.filter.class=org.apache.hadoop.metrics2.filter.GlobFilter
*.record.filter.class=${*.source.filter.class}
*.metric.filter.class=${*.source.filter.class}

The syntax of the filter class is explained as follows:

subsystem.[sink|source].sink_name.[sources|record|metric].filter.[include|exclude]
subsystem – daemon: hbase, yarn, hdfs, etc
sink|source – sink or source for feed
sink_name – name of sink used
sources|record|metric – level of filter to operate
include|exclude – will filter exclude or include metrics.

The filters can be applied at the level of source, record, or metrics and constructed with regex for trimming the information generated by the metrics system.

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Monitoring Hadoop
Published in: Apr 2015Publisher: ISBN-13: 9781783281558

Author (1)

author image
Aman Singh

Gurmukh Singh is a seasoned technology professional with 14+ years of industry experience in infrastructure design, distributed systems, performance optimization, and networks. He has worked in big data domain for the last 5 years and provides consultancy and training on various technologies. He has worked with companies such as HP, JP Morgan, and Yahoo. He has authored Monitoring Hadoop by Packt Publishing
Read more about Aman Singh