Entrepreneur. Advisor. AI and inference. Prev: ceo/founder @ambassadorlabs; product @duosec; corp dev/strategy @rapid7.

Joined January 2010
68 Photos and videos
Pinned Tweet
22 Jan 2025
I've been building an #ai application for a little while now, and wrote up my 7 macro takeaways about building an AI app that I didn't know when I started. thelis.org/blog/lessons-from…
184
18 May 2025
🔥
A quick update on the future of the `transformers` library! In order to provide a source of truth for all models, we are working with the rest of the ecosystem to make the modeling code the standard. A joint effort with vLLM, LlamaCPP, SGLang, Mlx, Qwen, Glm, Unsloth, Axoloth, Deepspeed, IBM, Gemma, Llama, Deepseek, microsoft, nvidia, internLM, Llava, AllenAI, Cohere, TogetherAI.....
1
107
13 May 2025
#Agents aren’t the future—they’re already here. But building them? That takes a whole new stack. 🧠 AI ⚙️ Durable execution 🧱 Frameworks 🗂 Context 🛠 Actuators Check out the breakdown (with @jflomenb and @Wing_VC): 🔗 wing.vc/content/the-agentic-…
1
1
4
1,420
13 May 2025
This is the agentic runtime stack—what’s needed to run autonomous, goal-directed agents in production. #AgenticAI #LLM #AIinfrastructure
54
12 May 2025
Context Is King 👑. Smarter agents need richer context—not just prompts. They aggregate context from multiple sources: 🧠 Knowledge (vector databases) 💾 Memory (short/long-term) 🌐 Actuators (APIs, sensors) Check out the full Agentic Runtime Stack: wing.vc/content/the-agentic-…
48
Richard Li retweeted
30 Apr 2025
Final chance to register for tomorrow's webinar with @InfoQ Learn how to design and implement the next generation of AI-powered services with Tyler and @rdli. See you there! bit.ly/42vzyFa #InfoQ #Java #AI
2
2
512
29 Apr 2025
Most apps act fast. Agents don’t. They pause, retry, wait hours or days. That’s why they need durable execution—resilient workflows that persist across failures. Check out our post on the agentic runtime stack: wing.vc/content/the-agentic-…
1
3
182
28 Apr 2025
I've noticed this too! It's a total sycophant, which is not helpful if you're looking for more critical thinking.
27 Apr 2025
the last couple of GPT-4o updates have made the personality too sycophant-y and annoying (even though there are some very good parts of it), and we are working on fixes asap, some today and some this week. at some point will share our learnings from this, it's been interesting.
85
28 Apr 2025
Agentic frameworks are expanding fast—most started with some sort of syntactic sugar around prompts, but they've since expanded into durable execution & memory. I teamed up with @jflomenb @wing_vc to map the stack 👇 🔗 wing.vc/content/the-agentic-… #LLMops #AgenticAI
1
1
177
Richard Li retweeted
2.1k stars, 2 million downloads, and 7000 models on Huggingface later, and I am officially ready to retire my long-time project AutoAWQ ⚡️ Proud to say that AutoAWQ has been adopted by the @vllm_project and will now be maintained by 55 contributors 🥳
13
13
181
47,462
14 Apr 2025
Fascinating! I have not thought deeply about the GPU market but clearly @evanjconrad has. GPU market is radically different from CPU market in a bunch of ways.
🆕 SF Compute: Commoditizing Compute latent.space/p/sfcompute We're excited for our latest deep dive into the compute market with @evanjconrad of @sfcompute! It should not be normal for the prices of one of the world’s most important resources right now to swing from $8 to $1 per hour (as @picocreator observed) based on drastically inelastic demand AND supply curves - from 3 year lock-in contracts to stupendously competitive over-ordering dynamics for NVIDIA allocations — especially with increasing baseline compute needed for even the simplest academic ML research and for new AI startups getting off the ground. The entire point of SFC is creating liquidity between GPU owners and consumers and making it broadly tradable, even programmable. As we explore, these are the primitives that you can then use to create your own, high quality, custom GPU availability for your time and money budget, similar to how Amazon Spot Instances automated the selective buying of unused compute. The ultimate end state of where all this is going is GPU that trade like other perishable, staple commodities of the world - oil, soybeans, milk. Because the contracts and markets are so well established, the price swings also are not nearly as drastic, and people can also start hedging and managing the risk of one of the biggest costs of their business, just like we have risk-managed commodities risks of all other sorts for centuries. As a former derivatives trader, you can bet that swyx doubleclicked on that… Also to end off, we of course had to ask about how on earth SFCompute manages to have such immaculate vibes.... Timestamps [00:00:05] Introductions [00:00:12] Introduction of guest Evan Conrad from SF Compute [00:00:12] CoreWeave Business Model Discussion [00:05:37] CoreWeave as a Real Estate Business [00:08:59] Interest Rate Risk and GPU Market Strategy Framework [00:16:33] Why Together and DigitalOcean will lose money on their clusters [00:20:37] SF Compute's AI Lab Origins [00:25:49] Utilization Rates and Benefits of SF Compute Market Model [00:30:00] H100 GPU Glut, Supply Chain Issues, and Future Demand Forecast [00:34:00] P2P GPU networks [00:36:50] Customer stories [00:38:23] VC-Provided GPU Clusters and Credit Risk Arbitrage [00:41:58] Market Pricing Dynamics and Preemptible GPU Pricing Model [00:48:00] Future Plans for Financialization? [00:52:59] Cluster auditing and quality control [00:58:00] Futures Contracts for GPUs [01:01:20] Branding and Aesthetic Choices Behind SF Compute [01:06:30] Lessons from Previous Startups [01:09:07] Hiring at SF Compute
1
52
14 Apr 2025
3. GPU businesses such as CoreWeave should be viewed through more of a finance lens than a tech lens.
1
106
14 Apr 2025
4. There can (and are) viable software inference businesses, but they need to be decoupled from GPU supply.
36
Richard Li retweeted
24 Mar 2025
The era of #agenticAI is here. #AIagents are replacing manual workflows—making decisions, taking action, scaling fast. Learn how to design and implement the next generation of AI-powered services. 🔗 bit.ly/4hJea3v #Java @InfoQ @rdli
2
3
652
Richard Li retweeted
5 Mar 2025
🚨 We're 1 day away! 🚨 Agentic AI is reshaping software—but scaling it isn’t easy. → TPS skyrockets → LLMs struggle with latency → Costs add up fast How do you build services that can handle agentic scale without breaking the bank? Join Tyler Jewell & @rdli tomorrow at 10 AM ET as they break it all down. Live Q&A included! 📅 Register here→ bit.ly/43GeLjd #Akka #AppDevelopment #CloudComputing #CloudNative #DevOps #DistributedSystems #SoftwareDevelopment #AgenticAI #LLMs #LLM #AIAgent #AI

3
6
550
21 Feb 2025
My friend @bnfb introduced me to a critical component of product requirements: setting a price you're willing to pay. This seemingly simple change creates focus, reduces risk, and improves communication. More: thelis.org/blog/set-a-price
26