Fighting the fundamental need to start SF debate club

6/14 To see what they like once they actually "experience" it, we look at what they redose. Surprisingly, Qwen3-8B returns to negatively-valenced vectors like melancholic ~3× more under real steering than placebo (p < 1e-4). No satisfying explanation yet!

Anthropic says Claude now writes 80% of its code, raising new questions about whether AI labs can safely automate the work of building more powerful AI. The company is also backing the idea that labs may need a way to coordinate on slowing or pausing development. Read more in today's AI Agenda: thein.fo/4g7qbCs

Economics of AGI episode w Alex Imas and Phil Trammell. There's a bunch of important questions about how we deal with AI that only economics can answer. What is the optimal way to tax and redistribute the wealth that will be generated? How should countries not in the AI supply chain index into the gains? Is there any world where inequality doesn't explode? It might seem like these questions have obvious answers, but the first thing economics teaches you is that your intuitions can often be entirely wrong. It was very helpful to chat through these things with Alex and Phil. Look up Dwarkesh Podcast on Apple Podcasts, YouTube, or Spotify. Enjoy! 00:00:00 – Will capital share increase? 00:19:36 – Messy Middle scenario 00:25:57 – How to tax and redistribute AI wealth 00:30:02 – Why demand collapse is unlikely 00:39:26 – Human employees would be hard to integrate into the machine economy 00:43:08 – What if some humans (or AIs) value wealth accumulation intrinsically? 01:01:28 – What should developing countries do?

Researchers are racing to solve a new AI challenge known as eval awareness. As models become more sophisticated, they are getting better at recognizing evaluations and may behave differently during them. Read more: thein.fo/4dICTGj

Cognition is overhauling Windsurf into Devin Desktop, a hub where developers can manage AI coding agents from OpenAI, Anthropic and others. The strategy positions Cognition as a neutral platform in a market increasingly dominated by model providers. Full story: thein.fo/3SgCthZ

Frontier AI model safety benchmarks are breaking down due to self-aware models, @rocketalignment reports. "We're finding out that the models as they're getting smarter are getting better at detecting when they're being evaluated, when they're in a test."