Recursive self-improvement going from being a ridicule-worthy fringe sci-fi concept to a completely normalized part of the discourse which is “obviously the plan” is one of the more dramatic Overton window shifts I’ve experienced
There’s something disorienting about it, like if the sky suddenly turned red, and everyone acted like it had been that way all along
a model is not a database. it's an archive; like a .zip file. and prompts don't query a result set; they lossy decompress the archive. the answer isn't searched; it's generated. the complete opposite of what you are saying is true.
I’m getting tired of “experts” like this misunderstanding what they’re looking at.
LLMs are giant databases of stuff HUMAN BEINGS have done.
They are the EXHAUST of humanity.
Prompts are database queries into EXISTING DATA.
It’s a fuzzy search engine, not intelligence.
We’ve agreed to a partnership with @SpaceX that will substantially increase our compute capacity.
This, along with our other recent compute deals, means that we’ve been able to increase our usage limits for Claude Code and the Claude API.
To make a bit of an excuse for Microsoft: the world is just waking up to the fact that coding agents are general agents.
It’s bitter lesson adjacent: Writing and executing code will likely outperform years of handcrafting vertical-specific agents with expert knowledge.
Actually it might exactly map in bitter lesson: Program synthesis is a form of scalable search.
I had my AGI moment in 2019 with AlphaStar. A pure RL model (no training data) that learned StarCraft 2 by playing against itself for 200 ingame years.
It didn't just climb the ladder, it defeated world champions, rank 1 and others.