omg.. Deepmind just solved infinite memory 🤯
They just released a paper on Recursive Language Models (RLMs), and it effectively solves the "Context Rot" problem that plagues even the most powerful models like GPT-5.
Instead of trying to "remember" 10 million tokens in a single attention window, RLMs treat the prompt as an external variable in a Python REPL. The AI doesn't read the text, it navigates it.
How it works:
The model writes code to grep, slice, and recursively call sub-instances of itself on relevant snippets of the data.
Perfect Memory: By offloading context to the environment, the model maintains 100% precision regardless of document length.
Emergent Behavior: Without special training, models started using regex to filter data and creating recursive "verify-and-fix" loops.
Cheaper & Faster: Since it only "reads" the tiny slices it actually needs, the median cost is often lower than standard long-context calls.
The Results (on Multi-Doc Research):
→ GPT-5 Base: 0% (Crashed/Failed)
→ GPT-5 RLM: 91%
→ Reasoning over dense data:
→ Base: 0.04%
→ RLM: 58%
It’s a complete shift from "bigger windows" to "smarter navigation."