"More importantly though, data streaming is about connectivity", well-written and insightful thread overall. Highlighting this quote because I'm a bit biased too 😀
1. Thoughtworks notes that "Kafka continues toward its status as a de facto standard." noting that Kubernetes, Kafka, and the CSPs are becoming stable layers in the next gen stack and churn around alternative platforms seems to have waned. thoughtworks.com/content/dam…
Apache Kafka 3.0 is released! 🎉
Another step closer to remove ZooKeeper dependency. And of course many other improvements, bug fixes, and new features.
Thanks to 141 contributors and our RM @karantasis!
For more details check out the release blog post: blogs.apache.org/kafka/
Confluent and @elastic are excited to work together to make it easier than ever to integrate @apachekafka and Elasticsearch with the fully managed Elasticsearch Sink Connector. Read more from Confluent CEO @jaykreps on our expanded partnership: cnfl.io/confluent-and-elasti…
Join us tomorrow for a technical deep dive on Kafka’s load balancing feature. We’ll discuss the proposition of Incremental Cooperative Rebalancing as a way to alleviate stop-the-world and optimize rebalancing in Kafka APIs. Register here: confluent.io/online-talks/de…
Parquet support for @confluentinc S3 sink connector got merged. Highly anticipated, it was accomplished in one of my favorite ways: as a top quality community contribution! Thanks Tony Wei and Ryan Eakman! Available from source on github now, will ship with Confluent Platform 5.4
Distributed Systems are fascinating. I discuss load balancing in one of my favorites, Apache Kafka, at #KafkaSummit SF’19, one of the primary venues for distsys of our time. Talk starts in exactly 30 minutes! kafka-summit.org/sessions/st…
So many good sessions at #KafkaSummit, so difficult to chose which to see! This morning’s must-see for me are:
- @KaiWaehner at 11:00: Kafka and ML
- @karantasis at 11:55: Kafka Connect rebalancing improvements
- @jbfletch_ at 11:55 (also!!): Kafka and CDC
I wrote a popular blog post on "The Log" back at LinkedIn. Here's a follow-up on what's happening with event streams, stream processing, databases, Kafka, @confluentinc and what it means for the software architecture of companies. confluent.io/blog/every-comp…
Incremental Cooperative Rebalancing enables @apachekafka Connect to run at large scale for more centralized and manageable connector deployments. Learn about its design and implementation in this blog post by @karantasis: cnfl.io/incremental-cooperat…
It’s Confluent’s five year anniversary and #KafkaSummit SF is just around the corner. To celebrate, we’re offering a really good deal on tickets: $500 off your conference pass with code Confluent5 through Wednesday. cnfl.io/kssf19-social
Stoked to announce the @confluentinc@GirlGeekX dinner on 9/29 in our SF office — first of a series of dinners focused on bringing the OSS and Girl Geek communities together!✨Attendees will also get a free pass to Kafka Summit SF ✨See you there! 🙋♀️💕 eventbrite.com/e/confluent-g…
Improvements to Kafka Connect in @apachekafka 2.3 that caught @rmoff's eye include Incremental Cooperative Rebalancing, connector-level producer/consumer configuration overrides, added functionality to the /connectors REST endpoint & other logging changes. cnfl.io/kafka-connect-improv…
Events & stream processing are revolutionizing the world of movie production & the underlying financial infrastructure for @netflix which spent $8B on content in 2018. Learn more at #KafkaSummit SF. cnfl.io/kssf19-social
⏰ Tick Tock! What's the Time? ...and Why? Join us at @MatthiasJSax's talk at #KafkaSummit San Francisco on 9/30 to learn about time's crucial role in data stream processing and how to best configure #apachekafka and stream processing applications. cnfl.io/kssf19-social
When KIP-415 was merged a few weeks ago Kafka Connect matured its load balancing and joined the big league of distributed systems. Meet me at #KafkaSummit SF'19 where I'll present all the nitty gritty details of Incremental Cooperative Rebalancing cnfl.io/kssf19-register
And for those of you that wonder why did I tweet about this now and not when KIP-415 got merged back in June: Because now you can try Kafka Connect's new rebalancing by downloading the definite streaming data platform: confluent.io/download It's enabled by default!