Kafka 02: The Log

The board for this stage of the from-scratch Kafka build, Build Your Own Kafka - From Scratch. Follows Kafka 01: The Naive Queue, where the mailbox queue broke three separate ways, and hands off to Kafka 03: Segments and the Offset Index.

Before you start. This series builds a small copy of Kafka, a program that keeps a stream of events and lets many other programs read that stream at their own pace, the way LinkedIn built the real Kafka to move data between its own services. The last stage built a mailbox queue where the first program to read a message deleted it for everyone else, and that one habit broke it three ways: a second reader found the box empty, a crash lost everything still sitting in it, and a slow reader forced you to either drop messages or make the sender wait.