Apache Kafka Series - Kafka Cluster Setup and Administration [Video]

More Information
  • Setup a Zookeeper and Kafka cluster on three machines in AWS
  • Learn how to deploy Kafka in Production and understand the target architecture for clusters in AWS
  • Setup ZooKeeper Cluster, learn its role for Kafka and usage
  • Setup Kafka in Cluster-Mode with 3 brokers, including configuration, usage and maintenance
  • Shutdown and Recover Kafka brokers, to overcome the common Kafka broker problems
  • Configure Kafka Cluster with production settings and optimizations for better performances based on your workload
  • Setup web administration tools using Docker: ZooNavigator, Kafka Manager, Confluent Schema Registry, Confluent REST Proxy, Landoop Kafka Topics UI
  • Administer Kafka using Kafka Manager

This course is designed for system administrators, architects and developers. It includes a step-by-step guide for installing a ZooKeeper quorum and a Kafka cluster. Hands-on training on Kafka administration is also provided.This course has Amazon Web Services for our cloud environment, which is used by many companies around the world. AWS knowledge is a pre-requisite. This course reveals exactly how your Kafka cluster on multiple machines should be set up and configured. We will start with understanding the Kafka basics, cluster size and the configuration. We will also have hands-on learning on the AWS set up, single broker set up, multi broker set up, testing the cluster, Kafka manager (cluster management), demonstrating Kafka resiliency and so on. We will enlighten you on Kafka performance with respect to I/Os, network, RAM, CPU, OS (Operating System) and so on. Includes hands-on learning on how to run Kafka in production on AWS, how to change a Kafka broker configuration and we will also cover the advanced Kafka configurations.

Style and Approach

In this course, we will cover what ZooKeeper is, its architecture, its role in Apache Kafka, and the setup, installation, and configuration on multiple machines!

  • With over 4 hours of videos and around 50 classes, you will get a great understanding of how to deploy Kafka in production and you will understand the target architecture for clusters in AWS
  • You will learn what ZooKeeper? is, it’s role for Kafka, How to setup ZooKeeper? and its usage
  • You will have a complete understanding Kafka setup including setup, configuration, usage and maintenance etc.
  • You will have a Kafka broker shutdown and recovery demonstration, which will help you to understand how to overcome the Kafka broker problems
  • You will learn Kafka production settings and how to optimize settings for better performance
  • You will learn all the required tool setups such as ZooNavigator, Kafka Manager, Confluent Schema Registry, Confluent REST Proxy, Landoop Kafka Topics UI.
  • You will get hands-on learning on Kafka common Administrative tasks using Kafka Manager
Course Length 4 hours 16 minutes
ISBN 9781789346534
Date Of Publication 23 May 2018


Stéphane Maarek

Stephane Maarek is a solutions architect, consultant and software developer that has a particular interest in all things related to big data and analytics. He's also a best selling instructor for his courses in Apache Kafka, Apache NiFi and AWS Lambda! He loves Apache Kafka. He regularly contributes to the Apache Kafka project and wrote a guest blog post featured on the Confluent website, the company behind Apache Kafka. He also is an AWS Certified Solutions Architect and has many years of experience with technologies such as Apache Kafka, Apache NiFi, Apache Spark, Hadoop, PostgreSQL, Tableau, Spotfire, Docker and Ansible amongst many others. His favorite programming languages are Scala and Python, and he plans on learning Go soon. During his spare time, he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!