Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration
- Understanding Apache Kafka and the Confluent Platform
- Core concepts: Kafka brokers, producers, consumers, and topics
- The role of Kafka in data streaming and messaging pipelines
- Confluent-specific extensions: REST Proxy, Schema Registry, and Control Center
- Deep dive into Kafka cluster architecture: brokers, partitions, and replication
Module 2: Configuring Zookeeper Quorum
- Introduction to Zookeeper
- The role of Zookeeper within a Kafka cluster
- Determining appropriate Zookeeper quorum sizes
- Configuring Zookeeper parameters
- Implementing secure SSH access on servers
- Hands-on: Configuring Zookeeper (as a team and as a standalone service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Hands-on: Establishing a Zookeeper quorum
- Exploring Zookeeper’s internal file system
- Performance considerations affecting Zookeeper
- Demo: Managing Zookeeper using tools and Zoonavigator
Module 3: Configuring Kafka Clusters
- Refresher on Kafka fundamentals
- Key configuration parameters
- Hands-on: Configuring Kafka on a single broker
- Hands-on: Executing core Kafka commands
- Hands-on: Setting up a multi-broker Kafka cluster
- Hands-on: Testing Kafka cluster functionality
- Verifying cluster connectivity
- Configuring Advertised.listeners: critical settings
- Topic-level configuration strategies
- Setting up message ingestion and delivery pipelines
- Hands-on: Demonstrating Kafka resilience under failure scenarios
- Kafka performance factors: I/O, network, RAM, CPU, and OS tuning
- Additional performance considerations
- Hands-on: Modifying broker configurations
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Message production and consumption via CLI, Java, and Spring Framework
- Monitoring with tools such as Confluent Control Center and Elasticsearch
- Managing log files and offsets
- Architecting for high availability and disaster recovery
- Achieving high availability through replication
- Tuning producer and consumer performance
- Developing disaster recovery strategies
- Controlling failover and executing data recovery
- Setting up connectors
- Implementing Kafka Connect
- Enhancing Kafka security features
Summary and Path Forward
Requirements
- Hands-on experience with Linux-based operating systems and command-line interfaces
- Working knowledge of distributed system concepts
- Foundational understanding of networking principles and system configuration
Target Audience
- DevOps and Site Reliability Engineering (SRE) teams overseeing Kafka deployments
- System administrators managing Confluent and Zookeeper infrastructure
- Kafka developers and architects tasked with building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)