A richness of great insight on the
@BG2Pod from
@GavinSBaker ...too many to choose from but here's a few good ones:
“Something very important on open source: there’s this belief that it’s bearish for AI. It’s actually — maybe bearish for the frontier models — but really bullish for compute and hardware. If the frontier models are capturing less of the margin, then you’re going to spend more on compute. The better open source does, the better it is for compute providers..."
“Two things can be true. The majority of economic value may continue to accrue to the frontier — and man, has it ever accrued to the frontier thus far. And the majority of tokens consumed in the world may be open source — and they are today. I think this current state is likely to persist.”
"There is a belief that these data centers are commodities. I do not share that belief. In the same way that Elon was able to re-engineer a rocket from first principles and make it reusable, he engineered an electric car from first principles — I think he looked at data center design from first principles and designed something fundamentally different."
"My understanding is that Cursor and Anthropic have more tokens of proprietary coding data than anyone else — and each have more tokens of proprietary coding data than exist on the public internet. Cursor used Kimi K2.5, used their own private data, did some RL, some supervised fine-tuning, and got a really good model. Then they spent three weeks in the Colossus 2 cluster and got a model that 12 days ago was Pareto dominant with Composer 2.5. It suggests the Cursor data is very valuable for coding, and that XAI/SpaceX has a shot at being a real player in coding.”
“Nobody has run Mythos for a year continuously, and we may never know how smart each generation of models actually is or was — because we don’t have time to appropriately evaluate their intelligence before the next model comes out. This is a profound statement...Imagine Albert Einstein had just thought about fundamental physics 24 hours a day. He doesn’t have to eat, doesn’t have to sleep, never gets old, never has diminution of intelligence — and he thought for one year. We might already have solved a lot of these intractable problems. My takeaway was: however bullish I was on compute before, I’m just a lot more bullish.”
On
$NVDA: If all of his customers are going to compete with him, then why not compete with his customers? He has his own models that are really, really good — Nemotron 3.1 was really cool from a compute-efficiency perspective, and he’s always careful to release small models so as to not tread on Anthropic, OpenAI, Google’s toes. But that is a choice he is making. If the economics change, I think Nvidia can join the frontier and become one of the world’s largest cloud computing companies much faster than people think.”
“Clark’s analysis shows that XAI’s deal with Google for cloud computing generates more operating profit per gigawatt than Anthropic, than Meta, than Google, than OpenAI. Freda calculated a 55% IRR on Colossus 1. If you can borrow money at 6, 7, 8% and invest in something with a 55% IRR — I’m not the most sophisticated thinker, but that math maths.”
“I always imagine stocks as runners. In ‘22 that runner had gone downhill — it had a lot of energy. The market, particularly in the last two months, has run up a very steep hill. A lot of these stocks — forget climbing a mountain — they’ve gone straight up a cliff. They’re tired. They need to rest. Do they just rest at the top of the cliff, hang out in their harness, or do they need to go downhill for a bit? We’ll see. I do see a lot on X about finding the next bottleneck — I think that was the last game. That game is over.”