Apache Kafka Tutorial

The Streaming Platform Apache Kafka is a distributed event-streaming platform. Applications publish events (records) to topics, and other applications consume those events as they ...

Brokers A broker is a Kafka server process. A cluster runs several brokers; every topic partition is owned by one broker and replicated (leader/follower) across others for fault ...

Download the Binary The archive includes the broker, CLI tools, and KRaft tooling. Start in KRaft Mode (no ZooKeeper) The storage format step initializes the log directories; the ...

Create a Topic List and Describe Describe shows partitions, leaders, replicas and ISR - the cluster health picture for one topic. Produce and Consume Shell A (producer): Shell B ...

Producer Basics A producer sends records to topics. The mandatory configuration is bootstrap.servers and key/value serializers. A record carries a topic, key, value, headers and ...

Consumers A consumer reads records from partitions and tracks its offset in the group. It processes each record and (with manual commits) acknowledges progress. Consumer Groups ...

What Connect Does Kafka Connect moves data in and out of Kafka without writing custom clients. Connectors run as source (produce) or sink (consume) in worker processes. Typical ...

Dependencies Spring Boot auto-configures producers and consumers from application properties. Configuration Produce a Record KafkaTemplate.send publishes with a key for ordering; ...

Where Kafka Ordering Holds Kafka guarantees order only within a partition. Records for one key share a partition, so per-key order is solid; cross-partition global order does not ...

Operational Best Practices Design partition counts for broker count and load headroom. Use acks=all and sets replication factor 3 on production. Keep keys for ordering; avoid ...