More Information
  • Configure and run Apache Kafka source and sink connectors
  • Learn concepts behind Kafka Connect and the Kafka Connect architecture
  • Launch a Kafka Connect cluster using Docker Compose
  • Deploy Kafka connectors in standalone and distributed modes
  • Write your own Kafka connector

A comprehensive and new course for learning the Apache Kafka Connect framework with hands-on Training.Kafka Connect is a tool for scalable and reliable streaming data between Apache Kafka and other data systems. Apache Kafka Connect is a common framework for Apache Kafka producers and consumers.Apache Kafka Connect offers an API, runtime, and REST service to enable developers to define connectors that move large data sets into and out of Apache Kafka in real time. It inherits strong concepts such as fault-tolerance and elasticity thanks to being an extension of Apache Kafka. Kafka Connect can ingest entire databases, collect metrics, and gather logs from all your application servers into Apache Kafka topics, making the data available for stream processing with low latency. Kafka Connect standardises the integration of other data systems with Apache Kafka, simplifying connector development, deployment, and management. In this course, we are going to learn Kafka connector deployment, configuration, and management with hands-on exercises. We are also going to see the distributed and standalone modes to scale up to a large, centrally-managed service supporting an entire organisation or scale down to development, testing, and small production deployments. The REST interface is used to submit and manage connectors to your Kafka Connect cluster via easy to use REST API’s.

Style and Approach

Kafka Connect standardises the integration of other data systems with Apache Kafka, simplifying connector development, deployment, and management.

  • In this course, you will learn what is Kafka Connect, Kafka Connect architecture, how to deploy an Apache Kafka Connector in standalone and in distributed modes.
  • How to set up and launch a Kafka Connect cluster using Docker Compose.
  • You will be able to deploy Kafka Connect source connectors and Kafka Connect sinks connectors at the end of this course.
Course Length 4 hours 14 minutes
ISBN 9781789344738
Date Of Publication 29 May 2018


Stéphane Maarek

Stephane Maarek is a solutions architect, consultant and software developer that has a particular interest in all things related to big data and analytics. He's also a best selling instructor for his courses in Apache Kafka, Apache NiFi and AWS Lambda! He loves Apache Kafka. He regularly contributes to the Apache Kafka project and wrote a guest blog post featured on the Confluent website, the company behind Apache Kafka. He also is an AWS Certified Solutions Architect and has many years of experience with technologies such as Apache Kafka, Apache NiFi, Apache Spark, Hadoop, PostgreSQL, Tableau, Spotfire, Docker and Ansible amongst many others. His favorite programming languages are Scala and Python, and he plans on learning Go soon. During his spare time, he enjoys cooking, practicing yoga, surfing, watching TV shows, and traveling to awesome destinations!