Get in Touch

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup

  • Foundations of Apache Kafka and the Confluent Platform
  • Core concepts of Kafka brokers, producers, consumers, and topics
  • The function of Kafka within data streaming and messaging pipelines
  • Confluent enhancements: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster design: brokers, partitions, and replication mechanisms

Module 2: Configuring Zookeeper Quorum

  • Introduction to Zookeeper
  • The significance of Zookeeper in a Kafka cluster
  • Determining Zookeeper quorum size
  • Zookeeper configuration parameters
  • Setting up SSH on our servers
  • Practical Lab: Configuring Zookeeper (both as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical Lab: Establishing a Zookeeper quorum
  • Zookeeper's internal file system structure
  • Performance variables impacting Zookeeper
  • Demonstration: Zookeeper administration tools and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Essential Kafka concepts
  • Overview of Kafka configuration
  • Practical Lab: Configuring Kafka on a single broker
  • Practical Lab: Running Kafka commands
  • Practical Lab: Setting up a Kafka multi-broker (cluster) environment
  • Practical Lab: Testing the Kafka cluster
  • Verifying connectivity to your Kafka cluster
  • Configuring advertised.listeners: key settings
  • Topic-level configuration
  • Implementing message ingestion and delivery within topics
  • Practical Lab: Illustrating Kafka resilience
  • Kafka performance metrics: I/O, network, RAM, CPU, and OS
  • Kafka performance: additional influencing factors
  • Practical Lab: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Messaging transmission and reception (via CLI, Java, and Spring Framework)
  • Metrics and monitoring utilities (Confluent Control Center, Elasticsearch, and others)
  • Log file management and offset tracking
  • High availability and disaster recovery frameworks
  • Achieving high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery strategies
  • Failover control and data restoration
  • Connector configuration
  • Implementing Kafka Connect
  • Kafka security features

Wrap-up and Recommended Next Steps

Requirements

  • Proficiency with Linux-based operating systems and command-line utilities
  • Working knowledge of distributed systems principles
  • Basic understanding of networking protocols and system configuration

Target Audience

  • DevOps and SRE teams overseeing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects responsible for scalable system design
 16 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories