Course Outline
Module 1: Introduction to the architecture and configuration of the Confluent Apache Kafka cluster
- Kafka's role in modern data pipelines
- Differences between Apache Kafka and Confluent Kafka
- Core components: producers, consumers, brokers, topics, partitions
- Kafka cluster deployment models and scaling considerations
Module 2: Zookeeper Quorum Configuration
- What is Zookeeper?
- Zookeeper’s role in a Kafka cluster
- Zookeeper Quorum size
- Zookeeper configuration
- Implementing SSH on our servers
- Practical: Zookeeper configuration (as a team and as a service)
- Using the Zookeeper Command Line Interface (CLI)
- Practical: Zookeeper Quorum configuration
- Zookeeper internal file system
- Performance factors affecting Zookeeper
- Demonstration of management tools for Zookeeper and Zoonavigator
Module 3: Kafka Cluster Configuration
- Basic Kafka concepts
- Kafka configuration
- Practical: Kafka broker configuration
- Practical: Executing Kafka commands
- Practical: Kafka Multi-Broker Cluster configuration
- Practical: Kafka cluster testing
- Can I connect to my Kafka cluster?
- Advertised.listeners configuration: most important setting
- Topic configuration
- Configuration for downloading and ingesting messages in topics
- Practical: Demonstrating Kafka resilience
- Kafka performance: I/O
- Kafka performance: Network (RED)
- Kafka performance: RAM
- Kafka performance: CPU
- Kafka performance: Operating System (OS)
- Kafka performance: Others
- Practical: How to change Kafka broker configuration
Module 4: Advanced Kafka Configuration
- Landoop Kafka topic user interface, Confluent REST Proxy, Confluent Schema Registry configuration
- Sending and receiving messages (CLI, Java, and Spring framework)
- Monitoring metrics and tools (Confluent Control Center, Elasticsearch, etc.)
- Log files and offset management
- High availability and disaster recovery
- Ensuring high availability through replication
- Tuning producer and consumer performance
- Disaster recovery strategies
- Failover control and data recovery
- Connector configuration
- Kafka Connect implementation
- Kafka security features
Summary and Next Steps
Requirements
- Familiarity with distributed systems and messaging concepts
- Experience with the Linux command line
- Basic understanding of networking and system administration
Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Testimonials (5)
Αρκετή πρακτική εμπειρία, ο καθηγητής είναι γνώστες
Chris Tan
Course - A Practical Introduction to Stream Processing
Machine Translated
Κατά τη διάρκεια των ασκήσεων, ο James μου εξήγησε σε λεπτομέρεια κάθε βήμα που μου προκαλούσε δυσκολίες. Ήθελα να γνωρίζω όλα από την αρχή στο NIFI. Εξήγησε μου το πραγματικό στόχο του NIFI, ακόμη και βασικά θέματα όπως το open source. Καλύψε εντελώς κάθε concept του Nifi, αρχίζοντας από επίπεδο ξεκαθάρισης μέχρι επίπεδο προγραμματιστή.
Firdous Hashim Ali - MOD A BLOCK
Course - Apache NiFi for Administrators
Machine Translated
Ωτι το είχα από την αρχή.
Peter Scales - CACI Ltd
Course - Apache NiFi for Developers
Machine Translated
Ανακάλυψη/επισκόπηση κρίσιμων σημείων των θεμάτων που συζητήθηκαν.
Paolo Angelo Gaton - SMS Global Technologies Inc.
Course - Building Stream Processing Applications with Kafka Streams
Machine Translated
Informative and had correct level of detail I believe.
Asif Akhtar
Course - Distributed Messaging with Apache Kafka
Machine Translated