Apache Kafka

Apache Kafka is the platform that handles real-time data feeds with a high-throughput, and this book is all you need to harness its power, quickly and painlessly. A step by step tutorial with a practical approach.

Apache Kafka

Starting
Nishant Garg

Apache Kafka is the platform that handles real-time data feeds with a high-throughput, and this book is all you need to harness its power, quickly and painlessly. A step by step tutorial with a practical approach.
$20.99
$34.99
RRP $20.99
RRP $34.99
eBook
Print + eBook
$12.99 p/month

Get Access

Get Unlimited Access to every Packt eBook and Video course

Enjoy full and instant access to over 3000 books and videos – you’ll find everything you need to stay ahead of the curve and make sure you can always get the job done.

Code Files
+ Collection

Book Details

ISBN 139781782167938
Paperback88 pages

About This Book

  • Write custom producers and consumers with message partition techniques
  • Integrate Kafka with Apache Hadoop and Storm for use cases such as processing streaming data
  • Provide an overview of Kafka tools and other contributions that work with Kafka in areas such as logging, packaging, and so on

Who This Book Is For

Apache Kafka is for readers with software development experience, but no prior exposure to Apache Kafka or similar technologies is assumed. This book is also for enterprise application developers and big data enthusiasts who have worked with other publisher-subscriber based systems and now want to explore Apache Kafka as a futuristic scalable solution.

Table of Contents

Chapter 1: Introducing Kafka
Need for Kafka
Few Kafka usages
Summary
Chapter 2: Installing Kafka
Installing Kafka
Summary
Chapter 3: Setting up the Kafka Cluster
Single node – single broker cluster
Single node – multiple broker cluster
Multiple node – multiple broker cluster
Kafka broker property list
Summary
Chapter 4: Kafka Design
Kafka design fundamentals
Message compression in Kafka
Cluster mirroring in Kafka
Replication in Kafka
Summary
Chapter 5: Writing Producers
The Java producer API
Simple Java producer
Creating a simple Java producer with message partitioning
The Kafka producer property list
Summary
Chapter 6: Writing Consumers
Java consumer API
Simple high-level Java consumer
Multithreaded consumer for multipartition topics
Kafka consumer property list
Summary
Chapter 7: Kafka Integrations
Kafka integration with Storm
Kafka integration with Hadoop
Summary
Chapter 8: Kafka Tools
Kafka administration tools
Integration with other tools
Kafka performance testing
Summary

What You Will Learn

  • Download and build Kafka
  • Set up single as well as multi-node Kafka clusters and send messages
  • Learn Kafka design internals and message compression
  • Understand how replication works in Kafka
  • Write Kafka message producers and consumers using the Kafka producer API
  • Get an overview of consumer configurations
  • Integrate Kafka with Apache Hadoop and Storm
  • Use Kafka administration tools

In Detail

Message publishing is a mechanism of connecting heterogeneous applications together with messages that are routed between them, for example by using a message broker like Apache Kafka. Such solutions deal with real-time volumes of information and route it to multiple consumers without letting information producers know who the final consumers are.

Apache Kafka is a practical, hands-on guide providing you with a series of step-by-step practical implementations, which will help you take advantage of the real power behind Kafka, and give you a strong grounding for using it in your publisher-subscriber based architectures.

Apache Kafka takes you through a number of clear, practical implementations that will help you to take advantage of the power of Apache Kafka, quickly and painlessly. You will learn everything you need to know for setting up Kafka clusters. This book explains how Kafka basic blocks like producers, brokers, and consumers actually work and fit together. You will then explore additional settings and configuration changes to achieve ever more complex goals. Finally you will learn how Kafka works with other tools like Hadoop, Storm, and so on.

You will learn everything you need to know to work with Apache Kafka in the right format, as well as how to leverage its power of handling hundreds of megabytes of messages per second from multiple clients.

Authors

Table of Contents

Chapter 1: Introducing Kafka
Need for Kafka
Few Kafka usages
Summary
Chapter 2: Installing Kafka
Installing Kafka
Summary
Chapter 3: Setting up the Kafka Cluster
Single node – single broker cluster
Single node – multiple broker cluster
Multiple node – multiple broker cluster
Kafka broker property list
Summary
Chapter 4: Kafka Design
Kafka design fundamentals
Message compression in Kafka
Cluster mirroring in Kafka
Replication in Kafka
Summary
Chapter 5: Writing Producers
The Java producer API
Simple Java producer
Creating a simple Java producer with message partitioning
The Kafka producer property list
Summary
Chapter 6: Writing Consumers
Java consumer API
Simple high-level Java consumer
Multithreaded consumer for multipartition topics
Kafka consumer property list
Summary
Chapter 7: Kafka Integrations
Kafka integration with Storm
Kafka integration with Hadoop
Summary
Chapter 8: Kafka Tools
Kafka administration tools
Integration with other tools
Kafka performance testing
Summary

Book Details

ISBN 139781782167938
Paperback88 pages
Read More