1/ Today, I'm excited to announce ✨Mixlayer✨. Two years ago, I reoriented my life around a singular mission: to build the best inference platform for open source AI.

might do this to fix my tech neck

One of our most requested features, and frankly something I've been a bit embarrassed we've had missing for so long. Proud of how it turned out though, take it for a spin and let me know what you think!

if fable 5 agrees to do your work instead of downgrading you to opus, you’re in the permanent underclass

just to state the obvious: think there's a collison course between those who believe research and science should be open and those who believe we are in an accelerating singularity curve. I have many smart friends who have believed both for a while but seeing more and more their realization that these beliefs will be in conflict. I for one believe that America and the west needs open and distributed access to research and computation and sharing of ideas at all times.

This is the leopard telling you, plainly, it’s coming for your face. Building an AI product? Ask how Anthropic justifies a $1T valuation without major market expansion. What happens when they compete with you? They pulled up the ladder for researchers and engineers first. Anyone else is next. Anthropic believes it’s the one true arbiter of AI safety, and that erosion of its moat is an existential threat to society. That premise will justify any restriction or sabotage they want. Open source AI matters more than ever.

this is the biggest wake-up call to protect and nourish open source AI if you don't build out sovereign and independent models infra closed labs will patronize you to an insulting degree

of course i understand the second order effects. i just don’t agree with the world anthropic wants. i think it is darker, worse, and not nearly as safe as anthropic claims it is. i much prefer a world where progress is slow and diffuse, yet uncontrollable. capital consolidation is one of the biggest factors driving capability speed. if the secrets are out and models are distillable by default, margins get compressed, clusters get smaller, inference is cheap, training runs focus more on specialization than god models. the world gets to build the ai future together. i am unsympathetic to the arguments about china. they’re gonna build their chips eventually. we are racing to out-accelerate them and build an insurmountable lead and let a couple people be lightcone king in the name of western liberal values as a side effect. and then what? it’s dark. i will keep fighting against it.

June 9th Researcher Reciprocity License "if you train on it, you let us generate - reverse terms of use void" Status quo 1. We teach frontier devs with ICLR/NeurIPS papers, OSS Github contributions 2. They use it to make frontier models 3. Then ban us from exploring our ideas We need a new license, original thinkers can't be an underclass to a tyrannical researcher fiefdom

feels good man

spared no expense

chasing a crazy bug all day in our inference engine's fp8 support on qwen 397b.. 35b fp8 works fine, 397b produces gibberish, turns out it's a CUTLASS bug that everyone else just has a workaround for github.com/flashinfer-ai/fla…

I love the video of him taking a lap with Chris Harris in a 911 S/T youtu.be/btr6-kt6cL0?t=732&s…

sometimes, when I have a gnarly bug to find and fix, I'll try race codex to see who can figure it out first.

this plus 4 coding agents cooking in the background

On Macs caffeinate command will keep it from sleeping too theapplegeek.co.uk/blog/caff…

i bet people are starting to come to this same conclusion for lots of other saas they pay for

github PRs down again

Second this. Hugely influential book for me. I was a fairly experienced Java developer when I picked it up and it was such a humbling experience to read it. Totally new ways of thinking about problems for me at the time.