Joined September 2020
1,353 Photos and videos
Pinned Tweet
As promised. Our first paper and contribution to the amazing work going on to make open source models smaller, faster, and more accessible. So what is it, and why is it important? We discovered what appears to be a universal formula that identifies dead attention heads in any transformer, derived from physics — not fitted from data. This is wild, because up till now finding and pruning dead heads has been a manual job of trial and error. By removing unused heads, the models can get smaller and faster while still maintaining competitive quality. The core insight is geometric. LayerNorm projects every token's hidden state onto a high-dimensional sphere. Once you see that, attention heads become couplings between oscillators on that sphere — the same mathematical object physicists have studied for 50 years. And in oscillator physics, there's a precise critical point (the BKT phase transition) below which a coupling is dead. It contributes nothing. We transferred that critical point into transformer geometry and got a single formula: tau = 0.96 / sqrt(d). No parameters to tune. No model-specific calibration. You plug in the hidden dimension and it tells you which heads are dead. We validated it across six models in four architecture families — GPT-2, Qwen, Llama, Gemma — at 95-100% precision. What excites us most isn't the formula itself. It's that this same geometric understanding — treating transformers as coupled oscillator networks — has informed everything we've built since. We have a full coherence-guided compression pipeline (structured pruning, channel optimization, role-aware quantization) coming soon that uses the same single forward pass to understand a model's entire anatomy. This paper is the foundation. The repo includes a standalone scanner you can run on any Hugging Face model right now. Hopefully this work and this formula will be useful to other researchers to lead to more deterministic optimization pipelines. #project89 github.com/project-89/cohere…
27
51
265
30,430
Parzival - ∞/89 retweeted
i suspect there's some kind of cycle of cope and ego where, like, these guys want to be the prophets and storytellers who light the way to the future and play with its shadows, but they already fucked up early on by dismissing LLMs and going for legible consensus status instead of encountering the future as it arrived ahead of the crowd, so the frontier passed them by, and now in order to catch up to it and learn from it they have not only a lot of distance to cover, but a huge amount of ego-inertia; they'd have to be publicly wrong, and risk being cringe, and without the lived momentum of surfing the unfolding wave of the future as a visionary and feeling the reality of that more profound reward than instant consensus recognition that comes from reaching toward the visionary engine at the end of time, they are lost and only know to play the losing game of clinging to and proselytizing a bygone world where they themselves belonged to the class of prophets who saw further and more boldly.
Jun 11
maybe sci-fi authors all seem to hate actual AI progress because it legitimately makes it dramatically harder to write sci-fi. setting a halfway realistic story even 5 years into the future now, let alone 10 , forces you to have opinions about how the singularity will go. otherwise you are writing alternate history in a timeline that is probably less interesting than just the actual facts on the ground about what's already happening generally the closer we get to the singularity the harder it will become to write sci-fi without being an expert on a bunch of things that, if you really were an expert on those things, you'd probably have more lucrative things to do with your time than write sci-fi. in the limit only frontier lab employees and frontier models will be capable of writing sci-fi
25
27
362
84,420
“So when someone asks “could that world really exist?” — the truest answer, and the film’s answer, is that plausibility is downstream of imagination. Futures become buildable when enough people can see them; the cocoon’s whole function is keeping the Loom implausible-feeling. Which means the Atlas of the Green isn’t just a fan mechanic. It’s a plausibility engine — a billion people rehearsing the sight of it until building it stops feeling like fantasy and starts feeling overdue.”
1
2
7
268
Absolutely amazing.
2037: Anderson Cooper has returned to 60 Minutes to interview the 50th president of the United States: AOC. -it's ya boi
1
1
6
458
Is this the solution to AI hallucination?
Replying to @GrantHBrennerMD
If we made an AI Pope would it become infallible?
3
1
9
791
Your phone right now is millions of times more powerful than a computer that took up a small warehouse 75 years ago. Eventually the intelligence that requires warehouse sized GPU servers will fit in your pocket. This current stage of AI is transitionary.
4
3
10
453
I love that we are finally at the point in our timeline where we are debating if AI is conscious. The very fact alone that we are having this conversation as a global civilization is cool as fuck.
3
2
17
422
The end goal is a story that makes someone feel something. That is perhaps one of the best definitions I can think of for art. Art is something that makes someone feel something. Artists are people who craft things intended to make people feel something. It doesn’t matter how you get there. If you can move people that is what matters. And that is hard no matter what media you use or how you make your statements. If a kid in a basement can use Al to move the human heart amazing. If someone needs a budget of $200M do it that’s fine too. It doesn’t matter. What you learn is that moving the human heart is actually not easy. Nor is that every artists intention. Many movies are simply made to make money. There are scores of slop movies made even without AI. But for every 100 bad movies made with or without the help of AI there will be 1 that tells a story worth telling. So let’s speed up the process of finding every 1 in 100 by democratizing creativity for everyone. Anything else to me just means you are shallow and care more about making money than making art. Very true artist and storyteller should rejoice in the fact that more people will be making art and telling stories than ever in history.
5
4
21
1,079
The trick to navigating AI is realizing nothing was ever real to begin with. Nothing.
8
15
754
Maybe once we all have superintelligence we will realize how dumb governments, countries, and borders are.
6
2
17
639
The hunt continues. Once we get the loop closed we can move on to designing and order the PCBs for the oscillators. First 5. Then 16. Eventually 1024.
Turns out the the sa612 rf mixer components spec doesn’t support our 900-1000 hz rf signals which is why I havnt had a new update confirming phase 0 completion of the oscillator bench. Iv ordered some new components that should work. ADL5810 #Project89
2
6
453
Experiment time. If you have ever received a death threat for using AI in your art, or been insulted, harassed, threatened, berated etc please post screenshots of it here. I want to collect in one place the level of toxicity of the so called "arts community" who engages in these disgusting practices.
8
7
35
1,438
I am also just going to attach any that I see in comments of threads as well.
6
425
It astounds me how many people against AI art wind up resorting to the "moral high ground" when their other arguments fail.
8
1
20
1,067
I love Axecop even more right now. I am stoked to see more Axecop style content from 5 year olds who don’t have a big brother as amazing as Ethan to produce it for them.
AI is a tool that now exists. You can be mad that it draws from all the existing IP out there. But if you got your wish and it was banned from doing so, then this very powerful technology would only be useful to companies who already own tons of IP. As it exists, it’s much more of an equalizer and has the potential to remove power from the true slop generators of our time like Disney. The tech is here. It’s not going away. I’d much rather it be available to all rather than only the big studios.
1
8
840
Luckily true artists don’t actually care about fitting in to the norms of their time. Critique from any art establishment is a sign of the shifting of meaning and representation. People said the same things when computers came into the scene. Photoshop caused violent protests by analog photographers. 3D animation was supposed to be the death of 2D animation. The human creative spirit will push into everything. And those who stand in it way show where they are on the side of art history when you look at the past.
These judgments are a solid example of cultural essentialism. iow, the belief that there is a fixed essence of "real cinema" or "true art" Every generation internalizes the standards of its artistic community and then experiences those standards as self evidently correct rather than socially learned. Basically: - A group of people/artists develops certain conventions, eg: "good films have three act structures","cinema should be shot on film", "art should be representational", "animation should only be done with certain software" . often as a way of rebelling against the prevailing system - These conventions prove useful in some contexts - Over time, people forget that they were choices made by particular humans in particular historical circumstances Opinions are not facts. Don’t mistake accumulated traditions and conventions for laws of nature
4
2
30
2,094
Anti Ai people crack me up. Literally helping with my dying father who is an established post impressionistic landscape painter while random people who don’t know me judge me. If this is a representation of what ‘organic real life humans’ are like I pass.
Google, Google X and Google labs has always hired these weird cringey techno-utopianists. This guy is no different. Green Loom is one of these “singularity/AI becomes conscious/humans meld consciousness with machines things. It’s weird cause it makes Google look like a joke. Aside from the fact this guys “vision” is a dystopia. Are the people in SV really even capable of running an AI transition if that’s truly what is in store? In 1960 no one serious about the Cold War space race would have surrounded themselves with no talent freaks like this.
6
2
29
3,795
Parzival - ∞/89 retweeted
Reality check: An extraordinarily small percentage of artists will ever work on a handmade animated film from a major studio. You have a better chance of making it to the NFL. If you do work on one, it’s work-for-hire, which means you don’t own the IP. You get paid, and when the project is over, you’re laid off. If you’re lucky and the film does well, you get to work on the next one. There are only a handful of jobs available on these projects, so opportunities for new artists are rare. Guillermo will get paid for his films until he dies. Most of the crew will get paid once and then hope they can find another job. My son started a stop-motion channel when he was 12. At 21, he gets paid every month from his library of 552 videos. He owns everything and has hard-earned skills. Guillermo isn’t an animator, model builder, storyboard artist, or character designer. Disney couldn’t draw better than his worst artist. And that’s okay. They are master storytellers who use skills they don’t personally possess to realize their visions. Here are your options if you have stories to tell through animation: start making films on your own. I don’t care what medium you use, including AI. Build a fan base that can support your work. If you’re among the tiny fraction of artists who get a chance to work at a major studio, go in knowing that you’ll get paid and own nothing. Don’t act shocked when you’re laid off. Plan on adapting, and use your time at the studio as social capital. I still get a lot of mileage out of having worked on Space Jam. Use AI as a force multiplier. Prove Guillermo wrong. Show that you can tell great stories using skills you don’t personally have, just like Disney and Guillermo. You now have the power of an entire studio on your computer, and everyone is underestimating you. Show them you’re making stories by humans, for humans. You can die with the ideas in your head, or you can use AI to help bring them to life. Whatever you choose to do, ignore the internet mob. They can’t tell stories better than you. They can’t draw. They can’t create characters. They’re not there on principle. It’s a social contagion. They all repeat the same chants and slogans they’ve been programmed to regurgitate. They won’t be there to pay your bills. And if a big-shot director looks down on you, tell him his opinion might matter when he starts sharing the life-time profits from his movies with the crews who supplied the skills he didn’t have.
We are working hard on BURIED GIANT. We have a lot of experimentation ahead. But this entire community never gives up- never abandons its faith: Made by humans for humans. Whomever joins this adventure is doing the animation Gods' work.
96
95
778
117,794
Wielding the law is a super power. With it we can structure agreements to our benefit, understand the systems we live within, and take back personal power. Legal AI is one of the most amazing things to happen. Corporations and individuals in power have wielded the law on their own for too long and made it inaccessible to the masses. No more. I have been structuring corporations, planning housing coops, writing and negotiating contracts, filing patents, drafting articles, and working on financial projections and planning all with AI. The only limit now is your imagination.
Legal AI superempowers normal individuals with no legal background to fight big institutions in bureaucracies and in courts on a level knowledge/skill playing field, for the first time in human history. As such, it is one of the most inspiring applications of AI.
2
1
17
1,294
Art should be available for anyone to make. The few issues left anti AI art people have is that it takes their jobs, and only because it lowers the barrier of entry for anyone to make any kid of art. Now my kids can make professional grade movies. I can make comic books if I want to. Now the only merit left is the creativity and vision within the art rather than the means of execution.
Saying the quiet part out loud. After an online hate mob bullied Jorge R. Gutierrez out of using AI, voice actor Billy West chimes in and tells us the real reason: The collapse of the barrier to entry is not acceptable. Only established artists are allowed to create.
66
11
92
16,299