Get in Touch
 Duration 21 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka architecture and configuration

  • The role of Kafka in modern data pipelines
  • Distinguishing between Apache Kafka and Confluent Kafka
  • Key components: producers, consumers, brokers, topics, and partitions
  • Cluster deployment models and scaling considerations

Module 2: Configuring Zookeeper Quorums

  • Overview of Zookeeper
  • Zookeeper’s function within a Kafka cluster
  • Determining Zookeeper Quorum size
  • Configuring Zookeeper
  • Implementing SSH on servers
  • Practical: Zookeeper configuration (as a team and as a service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical: Zookeeper Quorum configuration
  • The Zookeeper internal file system
  • Performance factors influencing Zookeeper
  • Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamental Kafka concepts
  • General Kafka configuration
  • Practical: Configuring Kafka brokers
  • Practical: Executing Kafka commands
  • Practical: Configuring a Kafka Multi-Broker Cluster
  • Practical: Testing Kafka clusters
  • Verifying connectivity to your Kafka cluster
  • Configuring Advertised.listeners: a critical setting
  • Topic configuration
  • Settings for downloading and ingesting messages within topics
  • Practical: Demonstrating Kafka resilience
  • Kafka performance: I/O
  • Kafka performance: Network (RED)
  • Kafka performance: RAM
  • Kafka performance: CPU
  • Kafka performance: Operating System (OS)
  • Kafka performance: Other factors
  • Practical: Modifying Kafka broker configuration

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, and the Spring framework
  • Monitoring metrics and tools (including Confluent Control Center, Elasticsearch, and others)
  • Managing log files and offsets
  • Ensuring high availability and disaster recovery
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Disaster recovery strategies
  • Failover control and data recovery
  • Configuring connectors
  • Implementing Kafka Connect
  • Kafka security features

Summary and Next Steps

Requirements

  • Knowledge of distributed systems and messaging concepts
  • Proficiency with the Linux command line
  • Fundamental understanding of networking and system administration

Target Audience

  • System administrators
  • DevOps engineers
  • Platform and infrastructure teams

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories