KV cache shouldn't disappear every time vLLM restarts. With @novita_labs, we're sharing PegaFlow — a production-grade external KV cache service that plugs into vLLM through the external KV connector interface. PegaFlow runs as a standalone Rust daemon owning the host KV pool, SSD cache, and RDMA resources. vLLM workers attach via CUDA IPC gRPC, and cache survives engine crashes, upgrades, and model switches. In production-oriented evaluations: 🚀 2.15× faster vLLM startup with a pre-warmed 500 GiB host pool 📈 56% higher throughput for 8 Qwen3-8B instances sharing one cache ⚡ 72% higher throughput for DeepSeek-V3.2 MLA TP8 (logical KV stored once, not per rank) 🌐 194 GB/s average remote-read throughput across nodes Three-level hierarchy: pinned DRAM, remote DRAM over RDMA, local SSD on io_uring. Integrates through the existing `kv_transfer_config` path — no vLLM source changes. 📖 vllm.ai/blog/2026-05-18-pega…

The biggest IPO run in the history of the market three $1T companies. possibly all going public in the next 12 months. SpaceX IPO: $1.75T. OpenAI IPO: $1T Anthropic IPO: $1T we're living through the greatest technological wealth creation in history.

OPENAI AND MICROSOFT $MSFT JUST ANNOUNCED AN AMENDED PARTNERSHIP AGREEMENT Here's what changes: Microsoft will no longer pay a revenue share to OpenAI OpenAI can now serve its products to customers across any cloud provider Microsoft continues to participate in OpenAI's growth as a major shareholder and retains a license to OpenAI IP through 2032 Revenue share payments to Microsoft continue through 2030 (Source Reuters)

Malaysia is spending about RM8.28 million per hour, or RM2,300 per second, on fuel subsidies to cushion the impact of global supply disruptions. The surge in crude oil prices has significantly increased fiscal pressure on the government, reports Berita Harian. nst.com.my/news/nation/2026/… 🧵1

Yesterday I drove my @tesla 900 miles on FSD from Miami to Nashville and I realized it’s genuinely the better option. I fly that route 2 to 3 times a month. Flights are never under $400. Most times $600. Sometimes $800. Add Uber to and from both airports, or parking garage fees. Then factor in the delays, the cancellations, the security theater, the chaos, the guy next to you who hasn’t met deodorant yet. On the other hand: I pack healthy snacks, press one button, and the car just goes. I took calls. Replied to emails. FaceTimed my family. Ate without pulling over. Did everything I normally do on a travel day, except none of the stuff that makes travel days miserable. My biggest concern going in was range and charging. Here’s what actually happened: My bladder needed one extra stop the car didn’t even suggest. Most charging stops were under five minutes. Total cost for the whole trip was less than just the uber to the airport. And this was the base model Y. Now I’m thinking I should get something comfier and just make this the default.