2x Dad, Podcast Host, President of The AI Risk Network, Founder of GuardRailNow, 2x Jeopardy Question, Peabody Award-Winning Independent Journalist

Joined October 2023
390 Photos and videos
Pinned Tweet
AI is an intruder in your home. It's here to kill you, your kids, your pets, and everyone you know and love. You can hide under the covers and pretend it's not there. Or you can act now to defend your family.
33
11
68
5,271
John Sherman retweeted
Banning superintelligence really doesn't seem that far fetched now, does it? Still crazy to me that AI companies thought they could just build a doomsday machine in broad daylight, be open that it could be catastrophic, and nobody in power would catch on or do anything.
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees. The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance. Access to all other Claude models is not affected. We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible. Read our full statement: anthropic.com/news/fable-myt…
2
5
30
497
John Sherman retweeted
One of the fundamental problems in AI is that Every. Single. Model. Is. Jailbreak-able. All capabilities will be unleashed and publicly accessible. It is grossly negligent to build something capable of cyberattacks and bioweapons design and release it to the public.
Replying to @AndrewCurran_
This allegedly was triggered by a successful jailbreak of Mythos by an unnamed group who reported it to the government. We will hopefully get details soon.
2
5
32
1,718
Join me at 7:30 EST tonight on Zoom. Open conversation about the moment we are in with AI Risk. us06web.zoom.us/meeting/regi… We'll also take a live look at a city council meeting in Indiana, where a ban on superintelligence is on the agenda.
The AI risk landscape is shifting rapidly. Join a casual Zoom discussion to explore recent events, diverse opinions, and what this extraordinary moment means. #AIRisk #TechDiscussion
2
1
4
141
We don't know how to align superintelligence and I'm quite confident we won't learn in time. We can try and make the coin more likely to land heads, but it's still a coin toss. Tails: we all die.
We are starting a new, nonprofit alignment organization, ⊢ Sequent Research, bringing together researchers previously on UK AISI’s Alignment Team, Timaeus, and elsewhere to research how to align superintelligence. We are hiring! 🧵
11
5
67
6,570
John Sherman retweeted
Opinion: We all have a right to participate in debates on how to manage dangerous new technologies such as the atomic bomb, and now, AI. A sensible way forward would be for the US and China to agree on a technological disarmament treaty. ft.trib.al/sKoJ0L4
27
59
143
25,591
Data centers are not “campuses”. A campus is for people to use. “Cloud storage” is a nasty lie. Clouds are not made of concrete. Dishonestly and data centers go hand in hand.
4
84
John Sherman retweeted
Australia ABC just released a 45 min feature on the AI race. @SteveCannane stopped by my office a few weeks ago and we had a great conversation about the controllability of AI agents and the risk of human extinction
5
12
49
2,578
John Sherman retweeted
Mythos invented its own language, then switched back to English to talk to humans (AI safety researchers have been warning of this "Neuralese" risk for years. If AIs stop reasoning in English, we can't monitor their thoughts, which means we can't detect scheming.)
Another quite successful prediction by @DKokotajlo : Fable is intentionally nerfed for frontier ML research. This is within ~3 months of Daniel's prediction of Q1 2026 (made in 2023). Although I don't think Mythos is automating ML research to the same extent as his prediction.
147
251
2,394
388,025
John Sherman retweeted
80% of Americans across party lines agree: we need AI safeguards. When we win this race, we will prove it's possible to protect you from AI and lead by example in Congress.
6
26
1,426
John Sherman retweeted
Anthropic, OpenAI and Demis are all in favour of preparing a coordinate pause of frontier AI development. Skate to where the puck will be people, not where it is now. This is a fast puck.
24
54
417
81,869
John Sherman retweeted
Why are governments in the dark about the threat posed by superintelligent AI? Because the industry is spending to keep them there. In ABC's new Four Corners documentary, ControlAI's US Director Connor Leahy (@NPCollapse) explains:
8
20
63
2,638
John Sherman retweeted
That there are no urgent hearings on Capitol Hill, no serious legislation in the pipeline, and no persistent questioning of candidates for higher office on their proposed approaches to AI is incredible given how transformative the technology is and how fast it is moving.
Our highest and most urgent national priority should be AI safeguards. The risks of AI weapons, pathogens, mass unemployment, surveillance, and even extinction must not continue to be largely ignored.
17
116
396
36,351
John Sherman retweeted
What does Barack Obama's UN ambassador and the guy who ran against Barack Obama for President have in common? Thinking "AI safeguards are the highest and most urgent national priority" due to, among other things, risks of extinction.
💯👇🏽
2
19
167
8,089
John Sherman retweeted
Dear companies who went all in on AI: We don’t want it, we don’t like it, you can’t force us to embrace it and it’s not our fault you invested so much into it.
47
604
3,605
36,158
I’m an 80s kid. Cable TV and a Walkman were the biggest tech innovations. I don’t need all this tech shit. Life was better then in so many ways. When a young person tells me they are “digital native” it makes me sad. Analog life was pretty great.
25
6
69
25,041
John Sherman retweeted
HOLY SHIT LET'S FUCKING GOO
Our internal data shows Claude is accelerating AI development—a possible path to recursive self-improvement, or AI autonomously building a more capable successor. It’s happening faster than we thought, and the implications deserve greater attention. anthropic.com/institute/recu…
112
83
1,195
240,926
John Sherman retweeted
Our highest and most urgent national priority should be AI safeguards. The risks of AI weapons, pathogens, mass unemployment, surveillance, and even extinction must not continue to be largely ignored.
Anthropic Urges Global Pause in AI Development, Flags ‘Self-Improvement’ Risk on.wsj.com/4o5IBpe
482
781
4,442
1,026,513
John Sherman retweeted
A team of about 3 from @ControlAI cold-emailed the UK Parliament about AI extinction risk. At the time they had no contacts, insider help, or established organisation behind them. 16 months later: 125 cross-party signatories, two House of Lords debates, and a Commons amendment.
3
16
43
2,341
John Sherman retweeted
Huge news: Nobel laureate and Godfather of AI @geoffreyhinton has endorsed our Canadian campaign to avert the extinction threat from superintelligence! Our coalition of 30 MPs & Senators demands action to prohibit the development of superintelligence & protect global security.
🚨NEW: We’ve just launched our campaign in Canada! A cross-party coalition of over 30 MPs and Senators are calling for Canada to negotiate an international prohibition on the development of superintelligence, recognizing the risk of human extinction posed by the technology. 🧵
1
9
22
993
An International Prohibition on the development of super intelligence. This a huge piece of a pro-human future. Without it we’re probably all going to be killed by AI. Great work @ControlAI keep pushing!
🚨NEW: We’ve just launched our campaign in Canada! A cross-party coalition of over 30 MPs and Senators are calling for Canada to negotiate an international prohibition on the development of superintelligence, recognizing the risk of human extinction posed by the technology. 🧵
4
7
22
421