Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration

  • Understanding Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The role of Kafka in data streaming and messaging pipelines
  • Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center
  • Deep dive into Kafka cluster architecture: brokers, partitions, and replication

Module 2: Configuring Zookeeper Quorum

  • Introduction to Zookeeper
  • The role of Zookeeper within a Kafka cluster
  • Determining appropriate Zookeeper quorum sizes
  • Configuring Zookeeper parameters
  • Implementing secure SSH access on servers
  • Hands-on: Configuring Zookeeper (as a team and as a standalone service)
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing a Zookeeper quorum
  • Exploring Zookeeper’s internal file system
  • Performance considerations affecting Zookeeper
  • Demo: Managing Zookeeper using tools and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Refresher on Kafka fundamentals
  • Key configuration parameters
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Executing core Kafka commands
  • Hands-on: Setting up a multi-broker Kafka cluster
  • Hands-on: Testing Kafka cluster functionality
  • Verifying cluster connectivity
  • Configuring Advertised.listeners: critical settings
  • Topic-level configuration strategies
  • Setting up message ingestion and delivery pipelines
  • Hands-on: Demonstrating Kafka resilience under failure scenarios
  • Kafka performance factors: I/O, network, RAM, CPU, and OS tuning
  • Additional performance considerations
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Message production and consumption via CLI, Java, and Spring Framework
  • Monitoring with tools such as Confluent Control Center and Elasticsearch
  • Managing log files and offsets
  • Architecting for high availability and disaster recovery
  • Achieving high availability through replication
  • Tuning producer and consumer performance
  • Developing disaster recovery strategies
  • Controlling failover and executing data recovery
  • Setting up connectors
  • Implementing Kafka Connect
  • Enhancing Kafka security features

Summary and Path Forward

Requirements

  • Hands-on experience with Linux-based operating systems and command-line interfaces
  • Working knowledge of distributed system concepts
  • Foundational understanding of networking principles and system configuration

Target Audience

  • DevOps and Site Reliability Engineering (SRE) teams overseeing Kafka deployments
  • System administrators managing Confluent and Zookeeper infrastructure
  • Kafka developers and architects tasked with building scalable systems

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories