Joined July 2022
277 Photos and videos
Pinned Tweet
May 21

32
43
512
570,808
Modal retweeted
some bts ><🌾 📡 driggs ave and S 1st
2
5
43
4,362
Modal retweeted
williamsburg too 🗽
around sf 🌉
4
2
48
20,506
Modal retweeted
Last fall, we shared our deep dive on FA4 internals. But we didn't stop at grokking the kernel. Since then, we've been developing improvements for inference performance and upstreaming them. This blog post explains those contributions. modal.com/blog/flash-attenti…
2
27
194
16,943
Modal retweeted
Tried to squeeze the most important bits about the entire stack for cloud deployment of transformer inference, from application layer concerns to hardware, debugging, and o11y, into one talk. Had to operate at a very high tok/s! youtube.com/watch?v=ZUdIsRZh…
10
25
293
16,870
Jun 4
With today's launch of Nemotron 3 Ultra, @nvidia continues to expand its investment in open-source AI. Their flagship frontier-reasoning model, built for long-running autonomous agents, is available Day 0 on Modal. - 550B with 55B active parameters - Hybrid Transformer-Mamba MoE architecture - 1M context - Up to 5x faster inference - Up to 30% lower cost
Jun 4
Introducing NVIDIA Nemotron 3 Ultra. A frontier smart open model built for long-running agents that need to plan, reason, use tools and keep working across complex coding, research and enterprise workflows. Up to 5x faster inference and up to 30% lower cost for agentic tasks. Learn more: nvda.ws/4x9nGps
12
15
135
14,227
Modal retweeted
we're hosting some parties to celebrate our C 💚 exclusive swag at both ofc
Jun 2
We're bringing together our friends and community to celebrate our Series C. Join us at Noguchi's Sunken Garden in NYC on June 16th or at the Legion of Honor in SF on June 25th. Invites are limited, apply here: modal.com/c-function
7
7
77
9,971
Modal retweeted
I love to see @modal being used for biology and cutting-edge research like this. Very cool work from the team at @biohub to push open models forward in protein design and comp bio. Here's how to run it on Modal: modal.com/docs/examples/esmf…
I’m so excited about the launch of ESMFold2, ESMC, and the new ESM Atlas. This was a massive team effort, and I’m grateful to have worked with such an incredible group @biohub. A headline result I’m especially excited about: ESMFold2 can design minibinders and antibodies with nanomolar affinity, target selectivity, and functional activity against therapeutically relevant targets. Today, we’re sharing the full binder design protocol.
4
10
70
12,138
Jun 2
We're bringing together our friends and community to celebrate our Series C. Join us at Noguchi's Sunken Garden in NYC on June 16th or at the Legion of Honor in SF on June 25th. Invites are limited, apply here: modal.com/c-function
9
7
119
41,104
Jun 1
Reinforcement learning has exploded on Modal, and we've been cooking. Here's a review of lessons learned helping teams train at scale, the patterns we kept seeing, and an open-source library to get started with RL on Modal quickly.
3
28
271
98,687
Modal retweeted
At @modal, we're working to make sure OSS RL frameworks have all the techniques necessary to train frontier open-weights models. Delta compression is key, but the job's not done. There are still lots of open problems around weight sync, auto-scaling, & cross-cluster training. My DMs are open!
@FireworksAI_HQ @cursor_ai highlighted why delta-compressed weight sync matters for RL at frontier scale. slime brings this capability to OSS: lossless delta sync for Megatron ↔ SGLang disaggregation — ship deltas, not full checkpoints. This is another step toward a fully open-source stack where rollout/inference and training are truly decoupled and deployed separately. PR: github.com/THUDM/slime/pull/…
7
22
246
64,169
May 29
Cyber attackers don't wait for you to spin up infrastructure. How @DoppelHQ uses Modal's elastic compute to scale inference, cut training overhead, and parallelize experimentation 👇
May 29
How does Doppel stay ahead of phishing campaigns that spin up millions of domains at once? Machine learning engineers William Gill and Ishana Shastri explain how they use @modal to: - React to sudden cyberattack influxes with highly elastic GPU clusters. - Replace complex Cloud Run and Docker setups with simple decorators in a single code file. - Make experimentation cost-efficient by running parallel experiments in the background. Learn more: doppel.com/blog/how-doppel-e…
1
1
18
4,783
May 29
Day 0 support for Step 3.7 Flash on Modal. - 198B parameter MoE with 11B active - 256K context - 3 reasoning levels - Native image & video understanding Great to work with @StepFun_ai and @sgl_project on this one.
2
8
96
22,004
May 28
Agents do a lot more than just write code now, and infrastructure guardrails need to keep up. Role-Based Access Control is now available to all Workspaces on Team and Enterprise plans.
2
10
92
35,905
Modal retweeted
Stanford CS25 Talk TOMORROW (Thurs, 5/28) at 4:30pm PST 🤖 Charles Frye (@charles_irl) from @modal on: Serving Transformers: Lessons from the trenches of production inference Training models is only half the battle. Actually serving them at scale is where things get real 👇 (1/6)
1
2
20
3,912
May 27
Today @biohub released the next generation of open models in the ESM family. These models achieve SOTA results in understanding how proteins interact with other molecules, essential for designing new drugs and antibodies. Try ESMFold2 on Modal: modal.com/docs/examples/esmf…
Today we're announcing ESMFold2, an open scientific engine to power prediction, design, and discovery across protein biology. The new model delivers state of the art performance on protein interactions, especially antibodies, a critical modality for therapeutics. We have designed and validated miniprotein binders and single chain antibodies across five therapeutic targets that are important in cancer and immunology. We are seeing very high success rates, and affinities at levels consistent with therapeutic activity. We’re also releasing an atlas of 6.8 billion proteins, and 1.1 billion predicted structures. ESMFold2 is built on a state of the art language model that has been trained on billions of protein sequences. A world model of protein biology emerges through language modeling. We’ve used the techniques of mechanistic interpretability developed to understand large language models to understand the concepts ESM uses to represent proteins. The model’s representation space has a compositional organization of features across scales, levels of complexity, and abstraction, that reflects and mirrors the understanding of protein biology developed through a century of empirical science. This understanding emerges without prior knowledge, just from language modeling of protein sequences. Language models are becoming a powerful substrate to understand and program biology. The design of protein interactions is one of the most fundamental problems in biophysics, and has critical implications for the discovery of new medicines. A simple gradient based search with the model was able to discover high-affinity protein binders. I'm excited by the potential this has to accelerate basic science and the understanding of proteins. And especially for the new avenues it opens up for therapeutic design and medicine.
2
7
60
11,972
May 27
Modal has been named to @Redpoint's 2026 InfraRed 100 — a list of 100 standout private companies shaping the future of infrastructure. Check out the full list here: redpoint.com/infrared/report…
1
4
68
5,202