Course Outline
Introduction to Distributed Messaging Systems
- Practical Use Cases
- Kafka Alternatives
The Kafka API
- Producer Interface
- High Level Consumer Interface
- Simple Consumer Interface
- Kafka Hadoop Consumer Interface
System Configuration
- Producer Setup
- Broker Configuration
- Consumer and Producer Parameters
Architectural Design
- Design Rationale
- Persistence Mechanisms
- Efficiency Optimisation
- Producer Architecture
- Consumer Architecture
- Message Delivery Guarantees
- Replication Strategies
Internal Implementation
- API Architecture
- Network Layer
- Message Structure
- Data Formatting
- Logging System
- Distribution Logic
Foundational Kafka Operations
- Topic Management (Add/Remove)
- Topic Modifications
- Graceful Shutdown Procedures
- Leadership Balancing
- Verifying Consumer Offsets
- Inter-Cluster Data Mirroring
- Cluster Scaling
- Broker Decommissioning
- Adjusting Replication Factors
Additional Topics
- Data Center Considerations
- Critical Server Settings
- Critical Client Settings
- Production Environment Configuration
- Monitoring Practices
- ZooKeeper Integration
Requirements
Familiarity with fundamental system administration practices and proficiency in at least one object-oriented programming language.
Testimonials (7)
Good prepared testing envoirment
Maciej Grabski
Course - Distributed Messaging with Apache Kafka
The documents
Jing Li - si ke xi tong (zhong guo) yan fa you xian gong si hang zhou fen gong si
Course - Distributed Messaging with Apache Kafka
Summary for the day, using white board to explain things step by step and the personal use cases that we are tasked to do.
Chee Meng Lee - CSIT
Course - Distributed Messaging with Apache Kafka
The preparation of virtual environments for participants to use and perform hands on learning.
marcus lim
Course - Distributed Messaging with Apache Kafka
Concepts, the way it presented, very communicative, very helpful, wide knowledge.
Sreenivasulu Narasingu - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The training was steered in the direction what the team wanted. The trainer is too good with vast experience in handling concepts like capability, performance, development and deployment standards and very swift in the training in addressing queries from different levels like regarding code, design, architecture and best practices etc.
Sarita Velagapudi - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The trainer really knows Kafka very well, and has a lot of production experience in the matter.