Apache Kafka Cookbook

Over 50 hands-on recipes to efficiently administer, maintain, and use your Apache Kafka installation
Preview in Mapt

Apache Kafka Cookbook

Saurabh Minni

1 customer reviews
Over 50 hands-on recipes to efficiently administer, maintain, and use your Apache Kafka installation
Mapt Subscription
FREE
$29.99/m after trial
eBook
$12.00
RRP $23.99
Save 49%
Print + eBook
$29.99
RRP $29.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$12.00
$29.99
$29.99 p/m after trial
RRP $23.99
RRP $29.99
Subscription
eBook
Print + eBook
Start 14 Day Trial

Frequently bought together


Apache Kafka Cookbook Book Cover
Apache Kafka Cookbook
$ 23.99
$ 12.00
Building Data Streaming Applications with Apache Kafka Book Cover
Building Data Streaming Applications with Apache Kafka
$ 35.99
$ 18.00
Buy 2 for $29.50
Save $30.48
Add to Cart

Book Details

ISBN 139781785882449
Paperback128 pages

Book Description

This book will give you details about how to manage and administer your Apache Kafka Cluster.

We will cover topics like how to configure your broker, producer, and consumer for maximum efficiency for your situation. Also, you will learn how to maintain and administer your cluster for fault tolerance. We will also explore tools provided with Apache Kafka to do regular maintenance operations. We shall also look at how to easily integrate Apache Kafka with big data tools like Hadoop, Apache Spark, Apache Storm, and Elasticsearch.

Table of Contents

Chapter 1: Initiating Kafka
Introduction
Setting up multiple Kafka brokers
Creating topics
Sending some messages from the console
Consuming from the console
Chapter 2: Configuring Brokers
Introduction
Configuring the basic settings
Configuring threads and performance
Configuring the log settings
Configuring the replica settings
Configuring the ZooKeeper settings
Configuring other miscellaneous parameters
Chapter 3: Configuring a Producer and Consumer
Introduction
Configuring the basic settings for producer
Configuring the thread and performance for producer
Configuring the basic settings for consumer
Configuring the thread and performance for consumer
Configuring the log settings for consumer
Configuring the ZooKeeper settings for consumer
Other configurations for consumer
Chapter 4: Managing Kafka
Introduction
Consumer offset checker
Understanding dump log segments
Exporting the ZooKeeper offsets
Importing the ZooKeeper offsets
Using GetOffsetShell
Using the JMX tool
Using the Kafka migration tool
The MirrorMaker tool
Replay Log Producer
Simple Consumer Shell
State Change Log Merger
Updating offsets in Zookeeper
Verifying consumer rebalance
Chapter 5: Integrating Kafka with Java
Introduction
Writing a simple producer
Writing a simple consumer
Writing a high-level consumer
Writing a producer with message partitioning
Multithreaded consumers in Kafka
Chapter 6: Operating Kafka
Introduction
Adding and removing topics
Modifying topics
Implementing a graceful shutdown
Balancing leadership
Mirroring data between Kafka clusters
Expanding clusters
Increasing the replication factor
Checking the consumer position
Decommissioning brokers
Chapter 7: Integrating Kafka with Third-Party Platforms
Introduction
Using Flume
Using Gobblin
Using Logstash
Configuring Kafka for real-time
Integrating Spark with Kafka
Integrating Storm with Kafka
Integrating Elasticsearch with Kafka
Integrating SolrCloud with Kafka
Chapter 8: Monitoring Kafka
Introduction
Monitoring server stats
Monitoring producer stats

What You Will Learn

  • Learn how to configure Kafka brokers for better efficiency
  • Explore how to configure producers and consumers for optimal performance
  • Set up tools for maintaining and operating Apache Kafka
  • Create producers and consumers for Apache Kafka in Java
  • Understand how Apache Kafka can be used by several third party system for big data processing, such as Apache Storm, Apache Spark, Hadoop, and more
  • Monitor Apache Kafka using tools like graphite and Ganglia

Authors

Table of Contents

Chapter 1: Initiating Kafka
Introduction
Setting up multiple Kafka brokers
Creating topics
Sending some messages from the console
Consuming from the console
Chapter 2: Configuring Brokers
Introduction
Configuring the basic settings
Configuring threads and performance
Configuring the log settings
Configuring the replica settings
Configuring the ZooKeeper settings
Configuring other miscellaneous parameters
Chapter 3: Configuring a Producer and Consumer
Introduction
Configuring the basic settings for producer
Configuring the thread and performance for producer
Configuring the basic settings for consumer
Configuring the thread and performance for consumer
Configuring the log settings for consumer
Configuring the ZooKeeper settings for consumer
Other configurations for consumer
Chapter 4: Managing Kafka
Introduction
Consumer offset checker
Understanding dump log segments
Exporting the ZooKeeper offsets
Importing the ZooKeeper offsets
Using GetOffsetShell
Using the JMX tool
Using the Kafka migration tool
The MirrorMaker tool
Replay Log Producer
Simple Consumer Shell
State Change Log Merger
Updating offsets in Zookeeper
Verifying consumer rebalance
Chapter 5: Integrating Kafka with Java
Introduction
Writing a simple producer
Writing a simple consumer
Writing a high-level consumer
Writing a producer with message partitioning
Multithreaded consumers in Kafka
Chapter 6: Operating Kafka
Introduction
Adding and removing topics
Modifying topics
Implementing a graceful shutdown
Balancing leadership
Mirroring data between Kafka clusters
Expanding clusters
Increasing the replication factor
Checking the consumer position
Decommissioning brokers
Chapter 7: Integrating Kafka with Third-Party Platforms
Introduction
Using Flume
Using Gobblin
Using Logstash
Configuring Kafka for real-time
Integrating Spark with Kafka
Integrating Storm with Kafka
Integrating Elasticsearch with Kafka
Integrating SolrCloud with Kafka
Chapter 8: Monitoring Kafka
Introduction
Monitoring server stats
Monitoring producer stats

Book Details

ISBN 139781785882449
Paperback128 pages
Read More
From 1 reviews

Read More Reviews

Recommended for You

Building Data Streaming Applications with Apache Kafka Book Cover
Building Data Streaming Applications with Apache Kafka
$ 35.99
$ 18.00
Fast Data Processing with Spark 2 - Third Edition Book Cover
Fast Data Processing with Spark 2 - Third Edition
$ 31.99
$ 16.00
Apache Kafka 1.0 Cookbook Book Cover
Apache Kafka 1.0 Cookbook
$ 27.99
$ 14.00
Learning Apache Flink Book Cover
Learning Apache Flink
$ 31.99
$ 16.00
Fast Data Processing with Spark 2 - Third Edition Book Cover
Fast Data Processing with Spark 2 - Third Edition
$ 31.99
$ 16.00
Hadoop 2.x Administration Cookbook Book Cover
Hadoop 2.x Administration Cookbook
$ 39.99
$ 20.00