I build intelligent machines.

Joined August 2010
4 Photos and videos
Releasing llmbuffer - a Python library that maximizes LLM prompt cache hits. It handles dynamic context, compaction, and tool output truncation or summarization via flexible hooks. Expect 10x cost savings in typical usage. pip install llmbuffer github.com/scottpurdy/llmbuf…
2
1
3
104
Why do we still have to select between models and reasoning levels? Those decisions should happen behind the scenes to maintain near optimal output with dramatically lower costs than always using the high end model.
1
4
Did Apple hire from TSA? There are so many permission dialogs that pop up at random times now.
2
2
30
Are there any good libraries for managing LLM context?
1
1
41
The bottleneck in human-agent workflows isn't just model capability; it’s human attention. I’ve been running an experiment called XO (Executive Officer) to explore ways to scale agent usefulness per second of user attention. 👇 (1/7)
1
67
Context windows are limited so scaling workflows requires chaining agents with constrained context. It requires specialization in multi-agent workflows, repeatable routines, and essentially building an OS for agents. (6/7)
1
30
XO lives at exoh.ai. Let me know if you’re interested in trying it, are also working in declarative agent frameworks, or otherwise want to connect. I’m planning to write more detailed deep dives when I can pull myself away from building long enough to do so! (7/7)

1
47
Scott Purdy retweeted
Tomorrow, we launch. At sunset tonight, Artemis II waits on the pad, ready to carry astronauts potentially farther than any humans have traveled in more than half a century. The next era of exploration begins.
1,572
6,565
47,976
1,978,306
Voter ID laws are critically important but it must also be free, easy, and fast for citizens to get the necessary documentation. Right now many places are in the exact opposite situation.
50
Never let your conviction exceed your understanding.
2
121
Great idea. This needs to happen!
I wonder how big of a boost it would give to the American economy to have a prominent "Made in America" filter across @amazon.
167
So much better than Google/Alexa/Siri where you end up memorizing the exact sentence structure needed and one wrong word completely breaks it.
ChatGPT, interrupted.
1
2
262
Scott Purdy retweeted
14 Apr 2023
America is the greatest country in the world 🇺🇸
42
89
958
226,632
Docker Desktop on Windows with WSL 2 is an amazing web dev setup.
1
1
320
- There's no right to own assault rifles - Abortion is a woman's right - Stop border detentions - Tax the rich - Racial discrimination is systemic - Eliminate greenhouse emissions no matter the cost - Don't prosecute drug possession A thread...
1
2
Tribalism & lack of critical thinking are bad because they reward populist rhetoric & satirical news rather than thoughtful analysis & first principles reasoning. “No one needs an assault rifle” has a nice zing. A deep analysis of the slippery slope of authoritarianism, less so.
1
1
Take away? Don’t fall into the trap. Have the humility to admit that you must be wrong on some of these issues and that many issues aren’t black and white. Identify the underlying values that lead people to both sides of the issue: righteousmind.com/