KIP-405 tiered storage hit production-ready status in Kafka 3.9 and is now the default cost-optimization lever for long-retention Kafka clusters. Here is the architecture, the configuration reality, and how it compares to the diskless-first alternatives.
Kafka 4.0 shipped KIP-848 and fundamentally changed how consumer group rebalancing works. Here is what actually changed, how to migrate from the classic protocol, and how to stop consumer lag from ruining your weekend.
A deep dive into Apache Pulsar's BookKeeper storage layer, multi-tenancy model, tiered storage, and subscription types, with production deployment guidance on Kubernetes and honest advice on when Pulsar outperforms Kafka and when it does not.
Apache Kafka 4.0 removed ZooKeeper entirely. If your cluster still runs in ZooKeeper mode, here is what that means, how the KRaft architecture actually works, and how to migrate without downtime.
Streaming databases like RisingWave, Materialize, and ksqlDB let you query live event streams with plain SQL and incrementally maintained views. Here is when they beat Flink and when they do not.
A principal cloud architect's guide to Kafka Schema Registry in production: choosing between Avro and Protobuf, understanding compatibility modes, and evaluating your options after IBM acquired Confluent.
A deep dive into NATS.io and JetStream: how the lightweight pub/sub system works, when it beats Kafka, and how to deploy it in production on Kubernetes.
Apache Kafka still dominates event streaming, but the operational tax is real. Here is a frank comparison of Redpanda, AutoMQ, and WarpStream, with a decision framework for when the alternatives genuinely win.
Change Data Capture (CDC) turns your database transaction log into a real-time event stream. Here's how Debezium, Fivetran, and CDC patterns work, and when to use them.
How stream processing works, when to use Kafka vs Flink, real-time architecture patterns like Lambda and Kappa, and lessons from building production streaming systems.
Practical deep dives on infrastructure, security, and scaling. No spam, no fluff.
By subscribing, you agree to receive emails. Unsubscribe anytime.