If you are not making it better, you are making it worse

"This move surprised no one." Anthropic has filed for a roughly trillion-dollar IPO, expected this fall. The filing was confidential, so the news was thin. The company's footprint on the agent economy is anything but. Mitchell Howe in yesterday’s Digest 👇

This just passed 2M views! If you haven't seen it yet, check out this AI In Context video on "If Anyone Builds It, Everyone Dies" youtu.be/Nl7-bRFSZBs?si=-re5…

Applications for plzdontkillus.com close soon. Here are some reasons why I think you should apply :)

Sam Altman now says he's "delighted to be wrong" about the jobs apocalypse "that some of the companies in our space advocate or talk about." With OpenAI's IPO approaching and public opinion souring, are the labs walking back their predictions? Read about this and more in the Daily Digest.

The most important movie to watch right now is available for free! In this video I explain why it is so important for you to watch it how to watch it for free :)

An internal model at OpenAI has autonomously disproved a central conjecture in discrete geometry, a mathematical field with applications in cryptography, wireless device communication, and medical imaging. The proof relates to a famous question posed by Paul Erdős in 1946. It has been verified by prominent mathematicians in a companion paper. The verifying mathematicians consider this to be a genuinely novel breakthrough on one of the most discussed problems in this area of mathematics. One called it “arguably the best known problem in Discrete Geometry.” Another observed, “If a human had written the paper and submitted it to the Annals of Mathematics and I had been asked for a quick opinion, I would have recommended acceptance without any hesitation. No previous AI-generated proof has come close to that.” The proof illustrates a general trend towards autonomous, agentic problem-solving in AI systems. OpenAI describes the system that produced the proof as a general-purpose model not specialized in mathematics. AIs can now perform long, novel chains of reasoning on difficult problems and are beginning to outstrip our ability to measure their progress. AI agents still perform best in domains with easily verifiable outputs, such as mathematics and cybersecurity. For example, Anthropic's Claude Mythos found thousands of vulnerabilities across every major operating system and web browser, and was deemed too dangerous for public release. Such capabilities are why the government is now more interested in evaluating frontier AI models. AI research is also a field with many easily verifiable outputs. Researchers at OpenAI and Anthropic take advantage of this fact to accelerate their work; senior researchers now claim they make only high-level decisions and let AI handle most of the coding. Experimenting with the coding capabilities of a publicly available AI system, like Claude Code, immediately demonstrates how far AI has come in the last year. OpenAI and Anthropic intend to use AI to enhance future models with minimal human oversight. To justify the urgency, these companies cite the importance of beating rival U.S. or Chinese labs. Many of the field’s foremost experts warn that this race ends with human extinction. Policymakers and researchers, including the founders of the AI revolution, are calling for international restrictions on the technology. A growing bipartisan and international consensus of political leaders agree.

The AI Doc is now available on streaming at Peacock. If you've been seeing it yet, now is the moment. Before it hit streaming, our friends Kevin Flick and Malory Graham at Small Planet Insights caught reactions from people walking out of the theater 👇

Best news I've heard in a while. A conversation between the US and China on AI risk is desperately needed and long overdue. Let's call on the @WhiteHouse to make it happen.

A big part of regulating AI to prevent a premature creation of ASI is to regulate the hardware it runs on. That would mean tracking every AI chip. Is that even possible? Well, here’s how @MIRIBerkeley’s Technical Governance Team’s international treaty proposal lays that out 👇 (at a high-level)

Reprehensible and counterproductive. This isn’t the way. Glad nobody was hurt.

Violence is not the way. Do not do this. I'm glad Sam and his family weren't hurt.

No government has a plan that would stop a dangerous AI. So @MIRIBerkeley's Technical Governance Team made one. In Part 2 of the series "How To Stop AI From Destroying The World" I break down how nuclear deterrence logic applies to superintelligence. Hard caps on compute, chip tracking, and restrictions on uncontrollable AI. The world has built rules for civilization-ending tech before. Can we do it again in time?

Go apply and build!

On the opening day of @theaidocfilm, I went to cinemas in NYC and asked people walking out a few questions about the film, AI, and what they'd say to the people building it right now. The answers were super interesting.

Is it possible to coordinate with China on AI governance? Critics of our proposed international agreement say no. But statements from Chinese government officials and academic figures paint a more optimistic picture:

The people racing to build superintelligence admit there's a high chance it ends in catastrophe. @MIRIBerkeley's Technical Governance Team published a draft international agreement to prevent premature superintelligence. First video in a series breaking down the whole thing👇