Monitoring the Storm cluster using JMX

This section will explain how we can monitor the Storm cluster using Java Management Extensions (JMX). The JMX is a set of specifications used to manage and monitor applications running in the JVM. We can collect or display Storm metrics, such as heap size, non-heap size, number of threads, number of loaded classes, heap and non-heap memory, virtual machine arguments, and managed objects on the JMX console. The following are the steps we need to perform to monitor the Storm cluster using JMX:

1. We will need to add the following line in the storm.yaml file of each supervisor node to enable JMX on each of them:

supervisor.childopts: -verbose:gc -XX:+PrintGCTimeStamps - XX:+PrintGCDetails -Dcom.sun.management.jmxremote - Dcom.sun.management.jmxremote.ssl=false - Dcom.sun.management.jmxremote.authenticate=false - Dcom.sun.management.jmxremote.port=12346   

Here, 12346 is the port number used to collect the supervisor JVM metrics through JMX.

2. Add the following...