Course Outline
Foundations of Distributed Messaging Systems
- Real-world Use Cases
- Alternatives to the Kafka ecosystem
Interacting with the Kafka API
- Producer API mechanisms
- High Level Consumer API functionality
- Simple Consumer API usage
- Integration via Kafka Hadoop Consumer API
System Configuration
- Configuring New Producers
- Broker setup and management
- Tuning Consumer and Producer parameters
Architectural Design Principles
- Design Motivations
- Data Persistence strategies
- Optimizing Efficiency
- Producer architecture
- Consumer architecture
- Understanding Message Delivery Semantics
- Replication mechanisms
Internal Implementation
- API Design considerations
- Network Layer operations
- Message handling
- Message format structures
- Log management
- Distribution logic
Essential Kafka Operations
- Managing topic addition and removal
- Altering topic configurations
- Performing Graceful shutdowns
- Balancing leadership across nodes
- Verifying consumer positions
- Mirroring data across clusters
- Scaling cluster capacity
- Decommissioning brokers safely
- Raising replication factors
Additional Topics
- Datacenter considerations
- Critical Server configurations
- Key Client configurations
- Production-grade Server settings
- Monitoring strategies
- Integration with ZooKeeper
Requirements
To successfully engage with this material, learners should possess foundational system administration expertise and a working knowledge of any object-oriented programming language.
Testimonials (7)
Good prepared testing envoirment
Maciej Grabski
Course - Distributed Messaging with Apache Kafka
The documents
Jing Li - si ke xi tong (zhong guo) yan fa you xian gong si hang zhou fen gong si
Course - Distributed Messaging with Apache Kafka
Summary for the day, using white board to explain things step by step and the personal use cases that we are tasked to do.
Chee Meng Lee - CSIT
Course - Distributed Messaging with Apache Kafka
The preparation of virtual environments for participants to use and perform hands on learning.
marcus lim
Course - Distributed Messaging with Apache Kafka
Concepts, the way it presented, very communicative, very helpful, wide knowledge.
Sreenivasulu Narasingu - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The training was steered in the direction what the team wanted. The trainer is too good with vast experience in handling concepts like capability, performance, development and deployment standards and very swift in the training in addressing queries from different levels like regarding code, design, architecture and best practices etc.
Sarita Velagapudi - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The trainer really knows Kafka very well, and has a lot of production experience in the matter.
