@apache_pulsar profile picture
Apache Pulsar @apache_pulsar

Distributed Pub-sub messaging system

Joined June 2017
  • Tweets 812
  • Following 3
  • Followers 8,164
186 Photos and videos
🎥 Watch Shiyan Xu from #Onehouse dive into high-throughput streaming Lakehouses with #ApacheHudi! ✨ Merge-on-Read ✨ Record-level indexing ✨ Async compaction ✨ Non-blocking concurrency ▶️ Full session:
hubs.ly/Q03YJR4b0 #DataStreaming #RealTimeData #DSS

High-throughput streaming Lakehouse with Apache Hudi

Discover how Apache Hudi's NBCC enables high-throughput, conflict-free streaming ingestion in Flink-powered lakehouse pipelines for real-time analytics.

streamnative.io
259
💡 Schema evolution at scale isn’t optional. In this #DSS session, Jan Siekierski breaks down: ❇️ Schema evolution strategies ❇️ Data contracts for governance & trust ❇️ Streaming data products in practice 🎥 Watch the recording ⤵️ hubs.ly/Q03YBgjd0 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Schema Management and Streaming Data Products

Learn how modern schema management transforms data streams into reliable, AI-ready streaming data products using GitOps and semantic validation.

streamnative.io
1
216
🚦 Safe Streams at Scale How #Uber safely deploys Flink jobs handling 4T messages/day? Yao Li & Yusheng Chen share Uber’s deployment safety framework — from incremental rollouts to automated rollbacks — cutting incidents by 38.5%. ▶️ Watch the full recording: hubs.ly/Q03Yrv690 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Safe Streams at Scale: Uber’s Deployment Safety Framework for Flink Jobs

Learn how Uber ensures safe, scalable Flink job deployments with its Deployment Safety Framework. Discover best practices for automated rollouts, testing, and rollback strategies that keep mission-...

streamnative.io
181
📊 Low-latency matters! #LazyLog helps event sourcing, activity logging & distributed databases perform faster with deferred ordering. 👉 Full talk by Ram Alagappan: hubs.ly/Q03Ykvy90 #DataStreaming #RealTimeData #DSS #datastreamingsummit

LazyLog: A New Shared Log Abstraction for Low-Latency Applications

Discover LazyLog, a new log abstraction that reduces write latency by deferring ordering until read time. Learn how this SOSP Best Paper Award system delivers low-latency, high-throughput performance...

streamnative.io
1
2
230
🤔 Are Your Kafka Guarantees Actually Guaranteed? Watch Lawrie Green & Connor McKee at #DSS2025 on: - Property-Based Testing ✅ - Autonomous Testing ⚡ - Validating “no message loss” & more💥 ▶️ hubs.ly/Q03Y84NN0 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Are Your Kafka Guarantees Actually Guaranteed?

Learn how to test and validate Kafka’s consistency and availability guarantees using autonomous testing with Antithesis. Discover how Kafka’s KRaft protocol enables configurable trade-offs between...

streamnative.io
1
232
🚀In the #DSS2025, Uber Onehouse break down how they use #ApacheFlink #ApacheHudi to push Cloudlake freshness to P90 < 15 min at massive scale. Topics: ⚡️ Streaming ingestion 🏗 Simpler, cheaper architecture 📈 Autoscaling & DR 📦 Hudi MOR for high-throughput writes ▶️ Watch now!
hubs.ly/Q03XZqN50 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Flink Streaming Ingestion to Cloud-lake at Scale

Learn how Uber uses Apache Flink and Hudi to power real-time data ingestion into its Cloud Lake for scalable, efficient, and secure machine learning.

streamnative.io
189
🚀 Salesforce streams 300B trace spans/day with Flink! Learn how they build real-time Service Dependency Graphs, handle variable & out-of-order traces, and optimize Flink for speed & memory. ▶️ Watch now!
hubs.ly/Q03XQm460 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Insights from streaming 300B telemetry trace spans per day with Flink

Discover how Salesforce processes 300B telemetry trace spans per day with Apache Flink. Learn real-world strategies for scaling stream processing, managing state, and handling out-of-order events in...

streamnative.io
176
⚡ Real-time matters. In this #DSS25 session, Naresh Kotha & Samip Singhal from @creditkarma share how session-aware signals power next-best recommendations as users act. ❇️ Sub-second decisions ❇️ Low-cost, always-on engine ❇️ End-to-end pipeline from signals → ranking ▶️ Watch the recording now!
hubs.ly/Q03XQfhD0 #DataStreaming #RealTimeData #DSS

Real-Time Recommendation Systems: Transforming User Experience Through Session-Aware Data

Learn how to build real-time, session-aware recommendation systems with Kafka and AI. Deliver personalized, sub-second recommendations at 100M user scale while preserving privacy.

streamnative.io
154
🚀 Dive into real-time analytics at #DataStreamingSummit 2025! Watch the exclusive session from #StarTree to learn how #ApachePinot handles billions of keys, speeds up restarts, and saves storage. ▶️
Don't miss out: hubs.ly/Q03XCJWv0 #DataStreaming #RealTimeData #DSS

Have Your Real-time OLAP and Upsert It Too

Discover how Apache Pinot enables real-time OLAP with native upserts. Learn how Pinot manages billions of primary keys per node while maintaining second-level freshness and high ingestion throughput...

streamnative.io
123
🚀 Unlock the power of unified streaming storage! 💡Dive into the #DSS2025 session to learn how #Ursa unifies #Pulsar & #Lakehouse for single-copy data, faster pipelines, and scalable storage! ▶️ Watch the recording now!
hubs.ly/Q03XCR9Z0 #DataStreaming #RealTimeData #DSS

From Pulsar to Lakehouse: Building a Unified Streaming Storage Engine with Ursa

Discover how Ursa unifies Apache Pulsar and modern lakehouses, enabling seamless real-time streaming, storage, and analytics in one platform.

streamnative.io
149
What does real-time look like at OpenAI scale? At #DSS2025, Adam Richardson explains how OpenAI built StreamLink, their Apache Flink-powered ingestion platform that delivers fresh, reliable data for both human and AI consumers. ▶️ Watch the recording now and bring real-time from “nice-to-have” to “mission-critical.” hubs.ly/Q03XsnL60 #DataStreaming #RealTimeData #DSS25 ️

StreamLink: Real-Time Data Ingestion at OpenAI Scale

Discover how OpenAI’s StreamLink, powered by Apache Flink, enables real-time ingestion into Delta Lake and Iceberg at massive scale.

streamnative.io
165
🌟 Flink SQL Changelog: Why it matters Upserts, deletes, retracts — they impact state size, compute latency. Join experts from #Confluent at the #DSS2025 to learn how operators handle change events & how to optimize for performance. ▶️
hubs.ly/Q03XfxWf0 #DataStreaming #RealTimeData #DSS25 ️
162
🚀 Low-latency streaming at scale! Naci Simsek shows how to optimize #ApacheFlink for speed, throughput & efficiency — key configs, checkpoints & async I/O. ▶️ Watch #DSS25: hubs.ly/Q03X0D5B0 #DataStreaming #RealTimeData #DSS2025 ️

The Need for Speed: Optimizing Apache Flink for Low-Latency Stream Processing

Learn advanced techniques to optimize Apache Flink for ultra-low-latency stream processing. This talk covers tuning, resource allocation, state backend choices, and bottleneck elimination for peak...

streamnative.io
1
179
📺 Netflix reveals how they handle extreme #Kafka loads - 700 clusters, 13,500 brokers, 65M viewers! Learn about automated capacity planning & client-side load shedding. ▶️ Watch the recording now!
hubs.ly/Q03X0zXd0 #DataStreamingSummit #RealTimeData #DSS2025 ️#Netflix

Kafka Under Pressure: Netflix's Blueprint for Unshakeable Kafka Resilience

Learn how Netflix ensures Kafka resilience under extreme traffic. Discover strategies for broker stability, adaptive clients, and high-throughput operations at scale.

streamnative.io
195
🎯 Complex data strict compliance doesn’t have to mean high cost. Learn how #Ursa, #Flink & #RisingWave enable real-time, cost-efficient architectures. Watch the DSS25 session. ▶️ Watch the #DSS25 session:
hubs.ly/Q03WQRJq0 #DataStreaming #RealTimeData #DSS2025 ️

Complex Business Requirements Lots of Data = High Cost? Not necessarily, here is why

Learn how StreamNative Ursa, Flink, and RisingWave enable cost-efficient architectures for complex, real-time, and compliance-driven data systems.

streamnative.io
2
228
Simplify schema governance across your streaming data ecosystem! 🚀 Watch this deep-dive session from #DataStreamingSummit 2025, learn how #ApachePulsar now integrates with external schema registries, decoupling schema management & unifying governance. ▶️ 
hubs.ly/Q03WG1vb0 #DataStreaming #RealTimeData #DSS2025

Unified Governance: Integrating Apache Pulsar with External Schema Registries

Learn how Apache Pulsar integrates with external schema registries like Confluent Schema Registry. Explore PIP-420, which decouples schema management from the broker to enable unified governance...

streamnative.io
1
239
This Thanksgiving, we’re configuring our holiday cluster for maximum performance: ✅ High Throughput: Turkey, stuffing, and pie. 🥧 ✅ Low Latency: The time between dinner and the nap. 😴 ✅ Retention Policy: Leftovers kept for infinite days. 🥡 Jokes aside, we are incredibly grateful for the amazing Apache Pulsar community. Thank you for streaming with us all year long! Happy Thanksgiving! 🧡 #Thanksgiving2025 #ApachePulsar #datastreaming
203
🚗⚡ Missed our webcast “From Connected Vehicles to Intelligent Agents: How DDS–Pulsar Bridges Enable Agentic Fleet Intelligence”? The recording is live! 💡Learn how DDS–Pulsar bridges create a unified real-time data backbone to power autonomous decisions, cross-system interoperability, and large-scale fleet intelligence. 👉 Watch Now: hubs.ly/Q03VNvZG0 #StreamNative #TrustGraph #ApachePulsar
202
🌟Session Highlight from #DSS 2025 | Unlocking Real-Time Insights: Apache Doris in Stream and Lakehouse Integration 🎥 Learn how to unify #ApacheDoris #Iceberg #Ursa to deliver sub-second query response times on petabyte-scale data lakes. 📉🚀 ▶️ Watch the recording now!
hubs.ly/Q03VNFhj0 #DataStreaming #RealTimeData #DSS2025

Unlocking Real-Time Insights: Apache Doris in Stream and Lakehouse Integration

Learn how Apache Doris integrates with Ursa and AWS S3 Tables to power real-time lakehouse analytics across Iceberg, Hudi, and Delta Lake.

streamnative.io
166
💬 The key to natural AI conversations? A truly conversation-fast backend. ⚡ Catch the #DataStreamingSummit recording to see how #FiveOneFour #StreamNative built real-time AI chat architectures—blending streaming, analytics, and orchestration into a low-latency, production-ready stack. ▶️ hubs.ly/Q03VnJkV0 #DataStreaming #RealTimeData #DSS2025 #AIChat

Building Real-Time Data Architectures for AI Chat With FiveOneFour and StreamNative

Learn how StreamNative and FiveOneFour build real-time, cloud-ready data architectures for conversational AI using MooseStack and streaming analytics.

streamnative.io
1
3
181
Load more