Get in Touch

Course Outline

Module 1: Introduction to the Architecture and Configuration of the Confluent Apache Kafka Cluster

  • Kafka's role in modern data pipelines
  • Distinctions between Apache Kafka and Confluent Kafka
  • Core components: producers, consumers, brokers, topics, partitions
  • Kafka cluster deployment models and scaling considerations

Module 2: Zookeeper Quorum Configuration

  • Overview of Zookeeper
  • Zookeeper’s role within a Kafka cluster
  • Quorum size requirements
  • Zookeeper configuration details
  • Implementing SSH on servers
  • Practical: Zookeeper configuration (team-based and as a service)
  • Using the Zookeeper Command Line Interface (CLI)
  • Practical: Zookeeper Quorum configuration
  • Zookeeper internal file system
  • Performance factors influencing Zookeeper
  • Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Kafka Cluster Configuration

  • Fundamental Kafka concepts
  • Kafka configuration basics
  • Practical: Configuring Kafka brokers
  • Practical: Executing Kafka commands
  • Practical: Configuring a Multi-Broker Kafka Cluster
  • Practical: Testing the Kafka cluster
  • Connecting to the Kafka cluster
  • Advertised.listeners configuration: the critical setting
  • Topic configuration
  • Configuration for downloading and ingesting messages into topics
  • Practical: Demonstrating Kafka resilience
  • Kafka performance: I/O
  • Kafka performance: Network (RED)
  • Kafka performance: RAM
  • Kafka performance: CPU
  • Kafka performance: Operating System (OS)
  • Kafka performance: Additional factors
  • Practical: Modifying Kafka broker configuration

Module 4: Advanced Kafka Configuration

  • Configuration of Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages (via CLI, Java, and Spring framework)
  • Monitoring metrics and tools (including Confluent Control Center, Elasticsearch, etc.)
  • Log files and offset management
  • High availability and disaster recovery
  • Ensuring high availability through replication
  • Tuning producer and consumer performance
  • Disaster recovery strategies
  • Failover control and data recovery
  • Connector configuration
  • Kafka Connect implementation
  • Kafka security features

Summary and Next Steps

Requirements

  • Familiarity with distributed systems and messaging concepts
  • Experience with the Linux command line
  • Basic understanding of networking and system administration

Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams
 21 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories