At Netflix, scale drives everything.
Their logging system ingests 5 PB/day, averaging 10M events/sec across 40K microservices to serve 300M subscribers.
See how they did it with some key optimizations in fingerprinting, serialization, and queries.
Real-time analytics just got easier. The fully managed @ClickHouseDB sink connector is now generally available on Confluent Cloud. It’s now simpler than ever to stream data from Apache Kafka® directly into ClickHouse.
Read how it works -> cnfl.io/4oS6FvY
CTO of @ClickHouseDB Alexey Milovidov, shows a mind blowing demo of air traffic telemetry indexed in ClickHouse. 150B records and immersive UI to explore it. This is only possible in ClickHouse. adsb.exposed ✈️
New distributed systems protocol write-up!
Virtual Consensus (Delos) heavily inspired the new architecture in Confluent’s Kora engine, powering Freight Clusters. This write-up dives into Virtual Consensus in Delos paper and why it makes sense as the default log replication protocol in the era of object storage and hybrid environments.
jack-vanlightly.com/blog/202…
Call for Speakers for DDD Europe, EventCentric, Data Mesh Live - 2025 is open on Sessionize and I've just submitted a session! sessionize.com/aardling2025/
TIL how to access secrets stored in 1Password from CLI scripts, e.g. to populate an environment variable using an API key stashed in my password manager
til.simonwillison.net/macos/…
Meetup Alert! Join Hellmar Becker & Thomas Iffland in Frankfurt on Thursday, Mar 7th for an Apache Kafka® meetup hosted by @ThinkportGmbH! If you are in Frankfurt, this will be a meetup you won’t want to miss!
meetup.com/frankfurt-apache-…