๐๐๐ ๐๐ข๐ญ๐๐ฎ๐ ๐ฌ๐ญ๐๐ซ๐ฌ ๐๐จ๐ซ ๐จ๐ฉ๐๐ง-๐ฌ๐จ๐ฎ๐ซ๐๐ ๐๐ข๐ฌ๐ค๐ฅ๐๐ฌ๐ฌ ๐๐๐๐ค๐ ๐จ๐ง ๐๐.
When we launched AutoMQ v0.6.6 as an open source project in November 2023, we started with one belief:
Kafka should become truly cloud-native.
Traditional Kafka was built around broker-local disks. At cloud scale, that often means expensive storage, cross-AZ replication cost, heavy partition reassignment, and complex operations around scaling.
AutoMQ takes a different path.
It is a Kafka-compatible streaming storage engine that moves Kafka storage from local disks to S3-compatible object storage, while keeping the clients, APIs, workloads, and ecosystem tools Kafka users already know.
Today, AutoMQ is one of the most mature open-source Diskless Kafka implementations, validated in production by industry-leading teams including Grab,
JD.com, Tencent, Honda, and more
Over the past two and a half years, AutoMQ has continued to contribute to the Kafka ecosystem:
1๏ธโฃ Diskless Kafka on S3, with shared storage instead of broker-bound local disks
2๏ธโฃ Stateless brokers for lighter scaling, reassignment, and recovery
3๏ธโฃ Table Topic, bringing Kafka streams directly into Apache Iceberg tables without a separate ETL pipeline
10K stars is more than a milestone. It is a signal that the Kafka community is actively exploring a more cloud-native future.
Thank you to everyone who starred the repo, tried AutoMQ, opened issues, shared feedback, contributed code, or challenged us to make the project better.
This is just the beginning.
GitHub:
lnkd.in/gt7NVRbh
#AutoMQ #ApacheKafka #Kafka #OpenSource #CloudNative #S3 #ApacheIceberg #StreamingData