Teaching AI the joy of invention at @Recursive_SI, Professor of AI @AI_UCL, PI @UCL_DARK, Fellow @ELLISforEurope. Ex @GoogleDeepMind @AIatMeta @CompSciOxford

Joined December 2010
432 Photos and videos
Pinned Tweet
My @iclr_conf 2025 Keynote on "Open-Endedness, World Models, and the Automation of Innovation" is now publicly available: iclr.cc/virtual/2025/invited…

10
44
386
60,201
Tim Rocktäschel retweeted
This is an important achievement, and probably the first in a predictable sequence of results that will lead to fully automating LLM and OMNI training and serving. As someone who has helped build some of the best multimodal and language models, I don’t see how this could play out any other way. What challenges will remain then? For me: environments and applications that matter like healthcare, materials, scientific exploration, and above all energy harnessing and lasting energy storage. With that we can solve carbon capture and end hunger.
9
21
130
30,700
Tim Rocktäschel retweeted
Another reminder of just how critical sovereign AI capabilities are. As an aside, @UKSovereignAI is hiring: sovereignai.gov.uk/about
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees. The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance. Access to all other Claude models is not affected. We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible. Read our full statement: anthropic.com/news/fable-myt…
28
14
176
16,989
Tim Rocktäschel retweeted
Automated AI research becomes real when it improves hard systems problems close to hardware limits. @Recursive_SI 's #1 public SOL-ExecBench result is a strong signal for the future of AI-assisted systems software: AI helping discover faster, more efficient GPU kernels on NVIDIA platforms🚀
AI is now doing our AI research. At Recursive we set out to build recursive self-improving superintelligence (RSI) to automate knowledge discovery. The best way to expand humanity’s knowledge is through the scientific method. RSI leads to better ideas, explanations and inventions which lead to better RSI. Automating the scientific method requires closing the loop between ideation, implementation and validation, and being able to run it over extended periods of time. Today, we are excited to share the first outputs of Recursive’s automated open-ended discovery system. To be clear, this system is merely a milestone towards RSI, a v0.1 of what I sometimes call the “Eureka Machine”. It is one program that you can point at any hard problem and get useful inventions out. Though it’s still very early, we've run it on three AI tasks and achieved state-of-the-art results on all three. These results demonstrate that even this early version of the system can solve a variety of autoresearch problems in AI and improve over prior state of the art. Concretely, it did this on the community benchmarks NanoGPT speedrun, NanoChat, and NVIDIA's Sol-ExecBench. AI is code and AI can code. The code and ideas that lead to these results were not invented by our team but by the AI system itself. To do RSI safely, we need to investigate its inventions. That's best done transparently with the community. @Recursive_SI we are open-sourcing the system’s discoveries, demonstrating that it finds creative and benign solutions instead of focusing on obvious optimizations or dangerous ideas. Link below.
1
4
21
5,024
Tim Rocktäschel retweeted
The UK has just committed to expanding its AI scholarship programme. The scheme fully funds exceptional AI students at 9 of the UK's top universities. It also actively helps these scholars take their skills into startups or to becoming founders themselves. NICE @KanishkaNarayan
2
8
62
6,191
Tim Rocktäschel retweeted
Extremely cogent and well-written scenario, starting from the present, warning about Europe’s dangerous trajectory. I was in Paris for the AI Summit after DeepSeek r1, and I can attest that the level of delusion about what that model meant was exactly as this scenario describes.
Most of Europe has not yet absorbed what AI is about to do to us. The few who have are not saying it loudly enough. We wrote Europe 2031: a five-year scenario of the continent's slide into irrelevance, how AI is driving it, and what can still be done to change course.
10
45
493
70,059
Tim Rocktäschel retweeted
there is no option other than staring the grim reality in the face and accelerating immediately.
"What will happen to Europe if it keeps ignoring AI?" Three American labs each (!!) operate more AI compute than all of Europe combined. Today we're launching Europe 2031: a story of what might happen if that doesn't change.
7
12
71
10,424
Well said!
I think narratives like the "permanent underclass" mindset can be very harmful. Not because they cause emotional depression, but they change the game-theoretic dynamics. People cooperate in prisoner's dilemma/commons scenarios when they believe the game has many turns. But if you believe the game only has a few turns, and that you should win otherwise you become the "permanent underclass", then the rational self-interested move is to defect: do whatever you can to win in the short term. I think the whole AI research community is in that scenario now. No one stays in academia to educate new talent. Frontier lab competition becomes more and more aggressive and toxic. I can't imagine how much public benefit those doomer narratives alone will cost us. Especially if they're wrong, which I think they are
1
23
7,499
Tim Rocktäschel retweeted
Lots of people have been asking me what we're up to at @Recursive_SI. We still can't say much quite yet, but we thought we'd share a little early demo. It turns out our automated researchers are pretty effective at performance optimization!
6
14
93
10,579
Tim Rocktäschel retweeted
Iirc, the value engram is the first novel arch change completely found by agents. Really impressive work!
Jun 11
Excited to share these preliminary results on our internal autoresearch system @Recursive_SI, where we achieve SOTA on nanochat / nanogpt speedrun / kernel benchmarks using the same underlying system without task-specific adaptations. blog: recursive.com/articles/first…
5
30
5,180
Tim Rocktäschel retweeted
Most of Europe has not yet absorbed what AI is about to do to us. The few who have are not saying it loudly enough. We wrote Europe 2031: a five-year scenario of the continent's slide into irrelevance, how AI is driving it, and what can still be done to change course.
85
162
885
338,930
Tim Rocktäschel retweeted
Jun 11
Domain 3: low-level GPU kernel optimization ⚙️ On Nvidia’s SOL-ExecBench, the same general system improved mean SOL score from 0.699 to 0.754 across 235 kernels - an 18% reduction in the gap to the theoretical optimum.
3
3
27
2,334
Tim Rocktäschel retweeted
Jun 11
Domain 2: squeezing more out of a mature highly optimized training benchmark ⚡ On NanoGPT Speedrun, starting from a solution refined by the community over 2 years, the system still found a sequence of discoveries to produce a further speedup: 79.7s → 77.5s.
2
3
16
1,861
Tim Rocktäschel retweeted
Jun 11
Domain 1: fixed-budget LM training ⏱️ On NanoChat Autoresearch, our system found a training recipe that reaches the same loss 1.3x faster than the best community solution, and substantially improves over the initial hand-optimized baseline.
1
3
30
4,163
Excited to show results of the first steps towards automated AI research at @Recursive_SI. The same general system achieved state of the art on @NVIDIAAI's SOL-ExecBench GPU Kernel Optimization, nanoGPT Speedrun, and @karpathy's NanoChat autoresearch benchmarks.
6
12
134
9,036
Essential content for anyone who cares about Europe's future in a world of AI acceleration!
Europe 2031: What getting AI wrong means for us - discussed it all with @SebJohnsonUK
7
3
26
3,883
Tim Rocktäschel retweeted
Europe 2031: What getting AI wrong means for us - discussed it all with @SebJohnsonUK
Europe is running the risk of sliding into complete and utter irrelevance if we do fix our approach to AI. @DadaJudith, alongside some of the greatest AI researchers in Europe, have written a predictive narrative outlining what will happen to Europe in the next 5 years if we don't drastically course correct. And it is BLEAK. The document reads like a short story and outlines how Europe slides into irrelevance due to fundamental mistakes made in AI. The things we truly love in Europe are at risk if we do not get this right, and we need to WAKE UP. European leaders have not taken AI seriously, and as a result our continent has fallen miles behind the US. It is NOT too late however, to turn things around and Europe 2031 explains what we need to do. I spoke to Judith this week about Europe 2031 and what can be done, so read the document or listen in and TAKE ACTION. This is one of the most pivotal moments in European history. Timestamps: 0:55 - Introduction 1:23 - Europe 2031 4:35 - Where Europe went wrong on AI 8:17 - Who the scenario is for 10:07 - Fixing Europe’s decision-making 12:28 - The trade-offs Europe must make 14:09 - Who should be driving change 15:43 - Sovereignty vs leverage 16:55 - Europe’s compute problem 19:30 - What sovereignty really means 21:17 - Measuring success for Europe 2031 22:28 - Five policy priorities for Europe 24:34 - Can Europe still change course? Amazing stuff from @bakkermichiel, @philip_fox_, @AlexTPet, @TomChivers among others
1
4
41
9,049
Tim Rocktäschel retweeted
Jun 10
Excited to announce we’ve raised $6.4M to build MNX, the AI exchange!
57
63
381
107,698