Apache Kafka Connect Training Course
Kafka Connect is an API designed for transferring large volumes of data between Apache Kafka and other systems.
This instructor-led, live training (available both online and on-site) is targeted at developers who want to integrate Apache Kafka with existing databases and applications for processing and analysis purposes.
By the end of this training, participants will be able to:
- Utilize Kafka Connect to import large datasets from a database into Kafka topics.
- Import log data generated by application servers into Kafka topics.
- Ensure that any collected data is accessible for stream processing.
- Export data from Kafka topics into secondary systems for storage and analysis.
Format of the Course
- Interactive lecture and discussion sessions.
- A wealth of exercises and practical activities.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
Course Outline
Introduction
Overview of the Apache Kafka Ecosystem (Zookeeper, Streams, Connect, etc.)
The Components of a Kafka Connect Cluster
Installing and Running Apache Kafka
Configuring the Connectors
Ingesting Database Data into Apache Kafka
Applying Transformations
Ingesting Data from a Web Server Log
Validating the Connection
Managing Connections with the REST API
Ingesting Real-time Data from the Web
Case Study: Reading and Transforming Data from Twitter
Processing and Analyzing Data with Kafka Streams
Deploying Kafka Connect
Writing Your Own Connector
Defining Dynamic Input/Output Streams
Monitoring and Managing Kafka Connect in Production
Troubleshooting
Summary and Conclusion
Requirements
- Experience with Apache Kafka.
- Java programming experience.
Audience
- Developers
Open Training Courses require 5+ participants.
Apache Kafka Connect Training Course - Booking
Apache Kafka Connect Training Course - Enquiry
Apache Kafka Connect - Consultancy Enquiry
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
The trainer tried to make the most complicated topics , explain it in simpler way
Calvin Raj Antony - SICPA SA
Course - Administration of Kafka Message Queue
Upcoming Courses
Related Courses
Administration of Confluent Apache Kafka
21 HoursConfluent Apache Kafka is a distributed event streaming platform designed for high-throughput, fault-tolerant data pipelines and real-time analytics.
This instructor-led, live training (online or on-site) is aimed at intermediate-level system administrators and DevOps professionals who wish to install, configure, monitor, and troubleshoot Confluent Apache Kafka clusters.
By the end of this training, participants will be able to:
- Understand the components and architecture of Confluent Kafka.
- Deploy and manage Kafka brokers, Zookeeper quorums, and key services.
- Configure advanced features such as security, replication, and performance tuning.
- Use management tools to monitor and maintain Kafka clusters.
Course Format
- Interactive lectures and discussions.
- Plenty of exercises and practice sessions.
- Hands-on implementation in a live-lab environment.
Customization Options for the Course
- To request a customized training session, please contact us to arrange.
Big Data Streaming for Developers
14 HoursLearn to implement end-to-end big data streaming use cases. Real-time data preparation and maintenance with Informatica, Edge, Kafka and Spark. This training covers software versions 10.2.1 and up.
Confluent Apache Kafka: Cluster Operations and Configuration
16 HoursConfluent Apache Kafka is an enterprise-grade distributed event streaming platform that is built on top of Apache Kafka. It supports high-throughput, fault-tolerant data pipelines and real-time streaming applications.
This instructor-led, live training (available online or onsite) is designed for intermediate-level engineers and administrators who want to deploy, configure, and optimize Confluent Kafka clusters in production environments.
By the end of this training, participants will be able to:
- Install, configure, and manage Confluent Kafka clusters with multiple brokers.
- Create high-availability setups using Zookeeper and replication techniques.
- Fine-tune performance, monitor metrics, and implement recovery strategies.
- Ensure security, scalability, and integration of Kafka within enterprise environments.
Format of the Course
- Interactive lectures and discussions.
- Extensive exercises and practical activities.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
Building Kafka Solutions with Confluent
14 HoursThis instructor-led, live training (online or onsite) is designed for engineers who want to utilize Confluent (a distribution of Kafka) to build and manage a real-time data processing platform for their applications.
By the end of this training, participants will be able to:
- Install and configure the Confluent Platform.
- Use Confluent's management tools and services to simplify running Kafka.
- Store and process incoming stream data efficiently.
- Optimize and manage Kafka clusters effectively.
- Secure data streams to ensure data integrity and privacy.
Format of the Course
- Interactive lectures and discussions.
- Plenty of exercises and practical activities.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- This course is based on the open-source version of Confluent: Confluent Open Source.
- To request a customized training for this course, please contact us to arrange.
Building Data Pipelines with Apache Kafka
7 HoursApache Kafka is a distributed streaming platform that has become the de facto standard for constructing data pipelines. It addresses a wide range of data processing challenges and can be utilized as a message queue, distributed log, stream processor, and more.
We will begin by delving into the theoretical foundations of data pipelines in general, followed by an exploration of the core concepts underlying Kafka. Additionally, we will examine key components such as Kafka Streams and Kafka Connect.
A Practical Introduction to Stream Processing
21 HoursIn this instructor-led, live training in Serbia (onsite or remote), participants will learn how to set up and integrate different Stream Processing frameworks with existing big data storage systems and related software applications and microservices.
By the end of this training, participants will be able to:
- Install and configure different Stream Processing frameworks, such as Spark Streaming and Kafka Streaming.
- Understand and select the most appropriate framework for the job.
- Process of data continuously, concurrently, and in a record-by-record fashion.
- Integrate Stream Processing solutions with existing databases, data warehouses, data lakes, etc.
- Integrate the most appropriate stream processing library with enterprise applications and microservices.
Distributed Messaging with Apache Kafka
14 HoursThis course is designed for enterprise architects, developers, system administrators, and anyone interested in understanding and utilizing a high-throughput distributed messaging system. If you have specific requirements, such as focusing solely on the system administration aspect, the course can be customized to better meet your needs.
Kafka for Administrators
21 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at beginner-level / intermediate-level / advanced-level system administrators and operations engineers who wish to use Apache Kafka to deploy, secure, monitor, and troubleshoot Kafka clusters.
By the end of this training, participants will be able to: explain Kafka architecture and KRaft mode, operate and secure Kafka clusters, monitor performance and reliability, and resolve common production issues.
Apache Kafka for Developers
21 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at intermediate-level developers who wish to develop big data applications with Apache Kafka.
By the end of this training, participants will be able to:
- Develop Kafka producers and consumers to send and read data from Kafka.
- Integrate Kafka with external systems using Kafka Connect.
- Write streaming applications with Kafka Streams & ksqlDB.
- Integrate a Kafka client application with Confluent Cloud for cloud-based Kafka deployments.
- Gain practical experience through hands-on exercises and real-world use cases.
Apache Kafka for Python Programmers
7 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Apache Kafka features in data streaming with Python.
By the end of this training, participants will be able to use Apache Kafka to monitor and manage conditions in continuous data streams using Python programming.
Kafka Fundamentals for Java Developers
14 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at intermediate-level Java developers who wish to integrate Apache Kafka into their applications for reliable, scalable, and high-throughput messaging.
By the end of this training, participants will be able to:
- Understand the architecture and core components of Kafka.
- Set up and configure a Kafka cluster.
- Produce and consume messages using Java.
- Implement Kafka Streams for real-time data processing.
- Ensure fault tolerance and scalability in Kafka applications.
Administration of Kafka Message Queue
14 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at intermediate-level system administrators who wish to harness Kafka's message queuing features effectively.
By the end of this training, participants will be able to:
- Understand Kafka's message queuing capabilities and architecture.
- Configure Kafka topics for message queuing scenarios.
- Produce and consume messages using Kafka.
- Monitor and manage Kafka as a message queue.
Security for Apache Kafka
7 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at software testers who wish to implement network security measures into an Apache Kafka application.
By the end of this training, participants will be able to:
- Deploy Apache Kafka onto a cloud based server.
- Implement SSL encryption to prevent attacks.
- Add ACL authentication to track and control user access.
- Ensure credible clients have access to Kafka clusters with SSL and SASL authentication.
Apache Kafka and Spring Boot
7 HoursThis instructor-led, live training in Serbia (online or onsite) is aimed at intermediate-level developers who wish to learn the fundamentals of Kafka and integrate it with Spring Boot.
By the end of this training, participants will be able to:
- Understand Kafka and its architecture.
- Learn how to install, configure, and set up a basic Kafka environment.
- Integrate Kafka with Spring Boot.
Stream Processing with Kafka Streams
7 HoursKafka Streams is a client-side library designed for developing applications and microservices that handle data flow within a Kafka messaging system. Traditionally, Apache Kafka has relied on external frameworks like Apache Spark or Apache Storm to process data between producers and consumers. By integrating the Kafka Streams API into an application, data can be processed directly within Kafka, eliminating the need to send it to a separate cluster for processing.
In this instructor-led, live training, participants will learn how to incorporate Kafka Streams into a series of sample Java applications that exchange data with Apache Kafka for stream processing.
By the end of this training, participants will be able to:
- Understand the features and advantages of Kafka Streams over other stream processing frameworks
- Process stream data directly within a Kafka cluster
- Create a Java or Scala application or microservice that integrates with Kafka and Kafka Streams
- Write concise code to transform input Kafka topics into output Kafka topics
- Build, package, and deploy the application
Audience
- Developers
Format of the course
- Part lecture, part discussion, exercises, and extensive hands-on practice
Notes
- To request a customized training for this course, please contact us to arrange