Building things / previously eng @malbeclabs_xyz @fleek @xmtp_ @DigitalOcean @Shopify
Joined April 2009
- Tweets 2,196
- Following 3,610
- Followers 1,095
- Likes 2,466
101 Photos and videos
Steven Normore retweeted
Jun 10
98
197
2,169
1,414,297
Steven Normore retweeted
May 21
turbopuffer crossed $100M run-rate in March. 19mo after $1M. Profitable & <$1M raised.
Cursor・Anthropic・Notion・Cognition・Harvey・Bridgewater・Ramp・Linear・Legora・Superhuman・Atlassian・Granola
We’d be nowhere without them. We work like hell to exceed their expectations.
252
150
3,442
1,383,957
Steven Normore retweeted
May 13
Attention isn't all you need - some attention is.
I've been exploring ways to reduce the compute and memory footprint of LLMs. I put it together in a repo: Calibrated Sparse Attention (CSA) is a one-time calibration pass on an existing model that figures out which keys each head in each layer actually uses, and you skip the rest. At matched LM quality I'm seeing potential for:
~10× longer context at the same memory bandwidth budget
~10× less KV-read bandwidth per token (with a sparse kernel)
~10× fewer attention FLOPs
~10× more requests per GB of KV memory (composed with eviction)
No retraining or labels needed.
1
1
4
242
Steven Normore retweeted
May 13
Been on a quest to make models run with a smaller memory footprint, especially locally on my laptop, so I built a hybrid SSM attention model with three memory layers:
• minimal attention KV for turns
• SSM state, MB-scale memory footprint for episodic
• LoRA from captures for long-term learning
Long context without the memory-bandwidth tax of GB KV caches, no prompt inflation. I'm curious to see how it scales to larger models.
github.com/jnormore/cognit
1
2
176
Steven Normore retweeted
May 9
173
520
4,477
2,731,239
Apr 24
Let agents write code and deploy it in sandboxed runtimes, with cron, webhooks, or MCP as primitives: github.com/jnormore/cue
Apr 24
"Make each program do one thing well" assumed humans were writing them. Slow, deliberate, by hand.
Agents flip this. They can author small, single-purpose programs constantly, for one task, for one user, torn down when no longer useful. The philosophy scales in a way its authors couldn't have imagined.
But durable work needs somewhere to live. Not a conversation context that evaporates. Not a workflow SaaS built for humans clicking through a GUI.
cue is that runtime. Agents push code into it over MCP. Actions they author become callable — by a schedule, a webhook, an app the agent spun up, another agent. Each call runs in a fresh sandboxed VM, so scale doesn't mean blast radius.
Here's how an agent OS starts.
2
251
Steven Normore retweeted
Apr 20
On @Solana, blocks are broken into smaller packets called shreds. They're the earliest public representation of what's happening onchain.
How those shreds travel determines who sees what, and when.
9
11
91
955,180
Steven Normore retweeted
Apr 17
My favourite part is the simulator modelux.ai/experimentation/
1
1
173
Apr 17
The control plane for your LLMs...
Apr 17
most teams have no view into what LLM calls they're actually making, or how cost breaks down across their business. they can't even try a different provider or model version, locked in by an implementation decision they can barely remember making, and the unknown of how each model behaves is too much.
most companies are juggling thousands of API keys and Claude Max subs so employees can use AI. no way to route by use case, no idea which teams are using which models.
i've been working on modelux to fix this. the control plane for your LLMs.
modelux.ai
2
212
Apr 16
Shreds over multicast on DoubleZero.
This was a fun project, and just getting started.
5
2
11
2,066
Steven Normore retweeted
Apr 16
Multicast allows the network to handle replication, rather than pushing that responsibility into application-layer systems.
Data is transmitted once and delivered across a shared distribution path, reducing divergence in arrival time and improving consistency across receivers.
Apr 16
5/ The @Solana ecosystem is rapidly adopting DoubleZero’s high-performance infrastructure:
Today there are:
→ 375 validators publishing shreds to DoubleZero Edge, representing approximately 45% of total Solana stake
→ 461 validators connected to the DoubleZero network, representing approximately 50% of total Solana stake
→ 95 devices across 30 metros, operated by 14 independent contributors
→ 50 DoubleZero Edge subscribers at launch
DoubleZero Edge already carries shreds from validators running every major @Solana client. @jito_sol, @temporal_xyz, @StakingFac and @triton_one have also joined as launch partners and ecosystem participants contributing to DoubleZero Edge.
View Edge’s data distribution model (multicast) in real-time: doublezero.xyz/multicast-das…
1
2
10
300
Steven Normore retweeted
Apr 16
Market data over the internet works.
Solana shreds over DoubleZero Edge wins.
DoubleZero Edge beta is live. ↓
55
74
331
318,706
Steven Normore retweeted
Apr 8
You don’t always need a bigger LLM, just more diverse ones.
So I built an ensemble inference proxy that sends prompts to multiple small models in parallel and combines their responses.
Initial results look great!
gpt-4.1-mini haiku qwen 3b (local): 74% accuracy.
GPT-5 alone: 73%. Claude Sonnet: 74%.
This ensemble config is 13x cheaper and 2.5x faster than GPT-5. And I haven’t even tested other providers yet.
The trick: cross-provider diversity. Same-family ensembles do nothing. But models from different providers make different mistakes, and that's exploitable.
Tested 27 configurations across 6 aggregation strategies. The best ensemble beats GPT-5 on knowledge tasks by 8 percentage points. Easy to experiment with your own configurations, just a YAML and emerge sweep.
github.com/jnormore/emerge
1
2
4
189
Steven Normore retweeted
Apr 6
Autonomous code/agent optimization: LLM proposes optimization ideas. Genetic algorithms evolve the best combinations.
That's cEvolve. Benchmarks show ~60% faster convergence (before parallelization) and more likely to hit top-tier results.
Inspired by @karpathy’s autoresearch.
github.com/jnormore/cevolve
2
1
7
283
Steven Normore retweeted
Mar 30
If your app can’t be used by agents better than a human can use it, it won’t survive.
The next generation of software isn’t designed for humans.
It’s designed for agents acting on behalf of humans.
2
6
404
Steven Normore retweeted
Mar 11
Introducing DoubleZero Edge.
DoubleZero Edge is a new platform delivering real-time market data to traders and market participants, powered by multicast.
Its first feed: raw Solana shreds directly from leaders, delivered over a high-performance fiber network.
Infrastructure that levels the playing field for validators and matches traditional trading systems is here.
Dive in ↓
98
115
575
516,346
Steven Normore retweeted
Mar 9
the singularity has begun. so many signs.
Mar 8
Who knew early singularity could be this fun? :)
I just confirmed that the improvements autoresearch found over the last 2 days of (~650) experiments on depth 12 model transfer well to depth 24 so nanochat is about to get a new leaderboard entry for “time to GPT-2” too. Works 🤷♂️
76
141
2,555
445,480
Steven Normore retweeted
Mar 5
Striking image from the new Anthropic labor market impact report.
551
2,222
13,355
7,270,297
Steven Normore retweeted
Feb 27
The correct answer to tabs vs spaces is fmt.
3
2
37
9,944
