- i'm angry about this because i personally and for others want access to fable, and simultaneously believe anthropic's safeguards were sufficient and the US government badly misunderstood the information they were presented - but in abstract this is in fact exactly what I want. it's heartening to see the USG treat artificial intelligence with the seriousness and immediacy it deserves. this kind of swift action is what might have a chance of saving us from unaligned RSI. - but i also very much don't trust *this* government to handle this well, to take sane unilateral action, to chart any kind of correct path. - and this escalates the global race enormously. this is as strong a signal as you can get to, not just China but the EU and even our closest allies, that the US will not be sharing this advantage. that if they want sovereignty they're going to have to fight for it - obviously, that was always the case, and it was always going to happen eventually. but i don't think now was the time to send that signal. it would have been better to delay as long as possible. very mixed feelings today

Haha, OpenAI invented this genre of stupidly trying to pull the ladder up.

So do we understand, now, why giving the government the power to regulate AI at the model level (which is Anthropic’s entire persona) is bad? Or are we going to continue to pretend we can give government this power without risking its abuse?

The Dario faction and the Sacks faction speak very different languages, and a Dario clarification could sound like a refusal. This puts us very squarely in vibe governance. Models are released when the gov thinks its okay, and it is unlikely this is based on technical evals.

More likely story: The "jailbreak" wasn't super serious (a situation anyone who has ever received bug reports is familiar with), Anthropic thought the demand to halt model was absurd, and Fed Gov used opportunity to punish and humiliate Anthropic for the prior sins of not bending knee. Anthropic has more credibility on such topics than Washington

I’ve had a number of conversations with folks inside and outside government about the current situation with Anthropic, and here is what I believe to be true: — As we know, Anthropic publicly released its Mythos class models earlier this week under the commercial name Fable. — Fable is Mythos with guardrails. But if those guardrails fail, then you’ve exposed Mythos and its advanced cyber capabilities to people who shouldn’t have them. (Keep in mind that Anthropic itself widely promoted the idea that Mythos was a cyberweapon and needed to be regulated as such. They asked for government regulation of Mythos and championed the guardrails on Fable. If there is a vulnerability — big or small — it is Anthropic’s responsibility to patch.) — A highly credible trusted partner of both Anthropic and the USG who was testing Fable came forward with a jailbreak of those guardrails. The Admin asked Dario to fix the jailbreak or de-deploy the model. Dario refused. — In their blog post, Anthropic defended its decision by saying the jailbreak isn’t serious. That is not what the trusted partner and the USG believe; nor is that kind of minimizing language consistent with Anthropic’s brand as the AI safety company. It’s difficult to fathom how they could claim a jailbreak allowing operability of a cyber weapon could be defined as not “serious.” — In the past, Anthropic has always said that safety must be top priority and taken super seriously. In this case, Anthropic prioritized the continued offering of the consumer model over safety. — In reaction, the Admin issued the export control. The Admin did this reluctantly. It’s been very surprised that Anthropic hasn’t wanted to cooperate with a reasonable safety request (ie fixing the jailbreak issue). Anthropic’s reaction is very much at odds with their branding and ethos as a safe AI research community. — The Admin’s hope now is that Anthropic remediates the safety issue, the export control is lifted, and Fable goes back into general release. The Admin wants all of this to happen as soon as possible. It is frankly bewildered that Anthropic hasn’t wanted to comply with safety requests that it previously said were its highest priority. — Those trying to misdirect and tie this action to the prior DoW/Anthropic issues are wrong. The Admin values Anthropic’s technical capabilities and feels that this issue, while serious, should be easily resolved. The ball is in Anthropic’s court.

I really don’t understand true greed. If I was worth $1 trillion, you’d have to physically stop me from solving as many of the world’s problems as possible. Everyone would have a home, food on the table, proper healthcare, happiness. I just don’t get it.

Surely Anthropic won’t do what they say they won’t do, right? Surely they will not stealth nerf and stealth introduce bugs into specific conversations of users at rival firms or in no-no conversations… you can trust Mr Amodei.

Oh, so now you realize everyone damn well has to get their AI safety policies right on the first try because if you screw up you might not be able to walk it back.

I remember back when 'ballot harvesting' first made news (2018), you got the impression ballots were just being collected and delivered. I remember one harvester telling the press she was told not to discriminate by party and didn't fill out the ballot herself. Now they are obviously not collecting ballots--they're generating them. ("if we fill it out together right now"). And they won't collect your ballot if you favor the wrong candidate or party. (Don't voter registration drives at least pretend they sign up everyone?)

Same here. By way of background for those who care, I spent a lot of time last week with senior members of the Anthropic team to understand what they do to ensure Claude is good for humanity and was impressed. Everyone I met was highly competent and cared a great deal about doing the right thing. No one set off my evil detector. So long as they engage in critical self-examination, Claude will probably be good. After that, I was ok leasing Colossus 1 to Anthropic, as SpaceXAI had already moved training to Colossus 2.

i finally understand why people become such open source model extremists. completely alien mindset to me before today

This government will not stand by while children are put at risk online. Today I am calling on the tech companies to introduce device-level controls to prevent children from taking, sharing or viewing nude images. And if they don’t act, we will.

The key finding of the report is that energy transition alone will not suffice. We need to combine it with "sufficiency" to stay within 2 degrees. This includes labour hour reductions, growth caps in rich countries, less material consumption, and changes in food habits.