This week I came across this very interesting series of articles on how to build a distributed queuing system from scratch from Tyler Treat. He was one of the maintainers of NATS Streaming - a Cloud messaging Kafka-like product. You’ll learn how a distributed system like NATS and Kafka works through 5 posts.
- Part 1: Storage mechanics
- Part 2: Data Replication
- Part 3: Scaling Message Delivery
- Part 4: Trade-offs and Lessons Learned
- Part 5: Sketching a New System
Enjoy the read 