Comprehensive Guide to Apache Kafka

Apache Kafka is an open-source distributed event streaming platform used for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Getting Started

• Intro to Kafka
• Kafka Architecture
• Installing Kafka
• Comparison
• Use Cases

Core Concepts

• Kafka Topics
• Kafka Partitions
• Kafka Brokers
• Kafka Producers
• Kafka Consumers
• Kafka Message Key
• Kafka Topic Replication
• Kafka Guarantees
• Kafka Listeners

Internals

• Kafka Configurations
• KRaft (Kafka Raft)
• Log Compaction

Operations

• Installing Kafka
• Monitoring
• Migration / Mirroring / Replication
  • MirrorMaker
  • Cluster Linking (Confluent)
  • Replicator (Confluent)
• Releases / Upgrades / Changelogs

Kafka Ecosystem

• Kafka Connect
• Kafka Streams
• Strimzi (Kubernetes Operator)

Client Libraries

• kafka-python

Tools

• kafkacat / kcat
• Kafka Commands

Security

• Kafka Security Overview

Confluent Components (moved to Confluent folder)

• Kafka Schema Registry
  • Schema Registry Compatibility Rules
• Kafka REST Proxy

Related Technologies

• Confluent Platform & Cloud
• Azure Event Hubs
• WarpStream (Confluent)

Additional Resources

• Others
• Slides - Kafka Fundamentals