Apache Kafka Series - Kafka Monitoring and Operations [Video]

More Information
  • Learn how to perform a safe and automated roll-restart of Kafka brokers
  • Update broker configurations in a safe way
  • Rebalance partitions in a Kafka cluster
  • Increase and decrease the replication factor of topics
  • Add a broker to a Kafka cluster
  • Service and replace a broker in a Kafka cluster
  • Remove a broker in a Kafka cluster
  • Install Command Line Interface (CLI) tools to automate workflows
  • Upgrade a Kafka cluster with no downtime

This course helps you learn Kafka administration, Kafka monitoring, Kafka operations, and Kafka upgrades. It covers the following topics:
Administration for Apache Kafka

  • Setup UI tools such as Kafka Manager, Zoo Navigator, and Kafka Monitor to get a full view of your cluster
  • Understand basic operations you can perform with these tools

Monitoring for Apache Kafka

  • A Kafka that is not monitored is a ticking time-bomb. 
  • Set up proper monitoring for Kafka and Zookeeper
  • Store your metrics in Prometheus and visualize them in Grafana

Operations for Apache Kafka

  • Perform the most common and difficult operations in your Apache Kafka cluster
  • Roll-restart your brokers in only one command
  • Update Kafka configurations safely with no downtime
  • Rebalance partitions and change the replication factor of your topics
  • Add, replace, and remove brokers.

Upgrades for Apache Kafka

  • Understand the subtlety of upgrading a Kafka cluster
  • Step-by-step explanations on upgrading a cluster with no downtime

All the code files are placed at https://github.com/PacktPublishing/Apache-Kafka-Series---Kafka-Monitoring-and-Operations

Style and Approach

This course will teach you Apache Kafka in depth, via practical examples.

  • Set up a multi-broker Kafka cluster in no time in AWS (using CloudFormation)
  • Set up administration tools such as Kafka Manager, ZooNavigator, and LinkedIn's Kafka Monitor
  • Set up monitoring using Grafana and Prometheus
Course Length 5 hours 3 minutes
ISBN 9781838558765
Date Of Publication 24 Jan 2019


Stéphane Maarek

Stephane Maarek is a solutions architect, consultant and software developer that has a particular interest in all things related to big data and analytics. He's also a best selling instructor for his courses in Apache Kafka, Apache NiFi and AWS Lambda! He loves Apache Kafka. He regularly contributes to the Apache Kafka project and wrote a guest blog post featured on the Confluent website, the company behind Apache Kafka. He also is an AWS Certified Solutions Architect and has many years of experience with technologies such as Apache Kafka, Apache NiFi, Apache Spark, Hadoop, PostgreSQL, Tableau, Spotfire, Docker and Ansible amongst many others. His favorite programming languages are Scala and Python, and he plans on learning Go soon. During his spare time, he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!