I build internet stuff. Previously creative director of @stripe, original designer of @openai, and founder of @quillchat.
Joined March 2008
- Tweets 429
- Following 301
- Followers 7,120
- Likes 1,516
53 Photos and videos
May 11
I was able to remove 90% of my deterministic guard rails, all my pre-loop classifiers, and reduce my system prompt by ~30% moving from GPT 5.4 -> 5.5. (tbf it had built up a lot of cruft 5.4 probably didn't need)
5.5 did it itself over ~8 hours total (never had anything run this long before! 3-4 sessions, mostly unattended), then it took me 2-3 hours to review and clean up. Would've taken me ~2 weeks on my own, probably.
3
9
1,288
Feb 23
bonus of working on an image/video agent: I thoroughly enjoy skimming through the eval results
5
14
2,756
Feb 21
Also the irony that LLMs aren't that great at writing system prompts
(tbc probably a skill issue)
1
1,693
Feb 21
Every time I catch myself trying to do clever system prompts deterministic guardrails (old world thinking) and instead rethink it into a few simple primitives, my little agent loops get like 2-3x more capable and 90% less brittle
Also: evals. Evals evals evals.
1
7
1,655
17 Jun 2025
1
2
155
16,885
6 May 2025
the curse of building a sandbox is it's quite fun in the sandbox itself
8
5,066
5 May 2025
11
5
115
13,758
19 Mar 2025
I just had my first instance of an LLM using a tool in an unexpected way but _it produced a valid output_ so yeah you could say I know what it's like to see your child take their first steps
1
9
4,683