Learning Apache Kafka - Second Edition

Start from scratch and learn how to administer Apache Kafka effectively for messaging

Learning Apache Kafka - Second Edition

Nishant Garg
February 2015

1 customer reviews

Start from scratch and learn how to administer Apache Kafka effectively for messaging

Mapt Subscription

FREE

€29.98/m after trial

eBook

€14.28

RRP €20.38

Save 29%

Print + eBook

€27.99

RRP €27.99

What do I get with a Mapt Pro subscription?

Unlimited access to all Packt’s 5,000+ eBooks and Videos
Early Access content, Progress Tracking, and Assessments
1 Free eBook or Video to download and keep every month after trial

What do I get with an eBook?

Download this book in EPUB, PDF, MOBI formats
DRM FREE - read and interact with your content when you want, where you want, and how you want
Access this title in the Mapt reader

What do I get with Print & eBook?

Get a paperback copy of the book delivered to you
Download this book in EPUB, PDF, MOBI formats
DRM FREE - read and interact with your content when you want, where you want, and how you want
Access this title in the Mapt reader

What do I get with a Video?

Download this Video course in MP4 format
DRM FREE - read and interact with your content when you want, where you want, and how you want
Access this title in the Mapt reader

€0.00

€14.28

€27.99

€29.98p/m after trial

RRP €20.38

RRP €27.99

Subscription

eBook

Print + eBook

Start 30 Day Trial

Code Files

Preview in Mapt

Book Details

ISBN 139781784393090

Paperback112 pages

Book Description

Kafka is one of those systems that is very simple to describe at a high level but has an incredible depth of technical detail when you dig deeper.

Learning Apache Kafka Second Edition provides you with step-by-step, practical examples that help you take advantage of the real power of Kafka and handle hundreds of megabytes of messages per second from multiple clients. This book teaches you everything you need to know, right from setting up Kafka clusters to understanding basic blocks like producer, broker, and consumer blocks. Once you are all set up, you will then explore additional settings and configuration changes to achieve ever more complex goals. You will also learn how Kafka is designed internally and what configurations make it more effective. Finally, you will learn how Kafka works with other tools such as Hadoop, Storm, and so on.

Chapter 1: Introducing Kafka

Welcome to the world of Apache Kafka

Why do we need Kafka?

Kafka use cases

Installing Kafka

Summary

Chapter 2: Setting Up a Kafka Cluster

A single node – a single broker cluster

A single node – multiple broker clusters

Multiple nodes – multiple broker clusters

The Kafka broker property list

Summary

Chapter 3: Kafka Design

Kafka design fundamentals

Log compaction

Message compression in Kafka

Replication in Kafka

Summary

Chapter 4: Writing Producers

The Java producer API

Simple Java producers

Creating a Java producer with custom partitioning

The Kafka producer property list

Summary

Chapter 5: Writing Consumers

Kafka consumer APIs

Simple Java consumers

Reading messages from a topic and printing them

Multithreaded Java consumers

The Kafka consumer property list

Summary

Chapter 6: Kafka Integrations

Kafka integration with Storm

Introducing Storm

Kafka integration with Hadoop

Summary

Chapter 7: Operationalizing Kafka

Kafka administration tools

Kafka cluster mirroring

Integration with other tools

Summary

What You Will Learn

Set up both single- and multi-node Kafka clusters and start sending messages
Understand the internals of Kafka's design and learn about message compression and replication in Kafka
Explore additional settings and configuration changes to achieve ever more complex goals
Write Kafka message producers and custom consumers using the Kafka API
Integrate Kafka with Apache Hadoop and Storm
Integrate Kafka with other tools for logging, packaging, and so on
Administer Kafka effectively and consistently with cluster management tools

Authors

Nishant Garg

Nishant Garg has over 16 years of software architecture and development experience in various technologies, such as Java Enterprise Edition, SOA, Spring, Hadoop, Hive, Flume, Sqoop, Oozie, Spark, YARN, Impala, Kafka, Storm, Solr/Lucene, NoSQL databases (such as HBase, Cassandra, and MongoDB), and MPP databases (such as GreenPlum).

He received his MS in software systems from the Birla Institute of Technology and Science, Pilani, India, and is currently working as a senior technical architect for the Big Data R&D Labs with Impetus Infotech Pvt. Ltd. Previously, Nishant has enjoyed working with some of the most recognizable names in IT services and financial industries, employing full software life cycle methodologies such as Agile and SCRUM.

Nishant has also undertaken many speaking engagements on big data technologies and is also the author of Learning Apache Kafka & HBase Essestials, Packt Publishing.

Chapter 1: Introducing Kafka

Welcome to the world of Apache Kafka

Why do we need Kafka?

Kafka use cases

Installing Kafka

Summary

Chapter 2: Setting Up a Kafka Cluster

A single node – a single broker cluster

A single node – multiple broker clusters

Multiple nodes – multiple broker clusters

The Kafka broker property list

Summary