Excited to be launching udio at long last! 1/6

New video! Memorable for its delightfully absurd name, the Hairy Ball Theorem is extremely beautiful and has some surprising applications. Full video here: youtu.be/BHdbsHFs2P0

We’re bringing a version of Deep Think that achieved gold-medal status at IMO to Ultra subscribers in the @Geminiapp ( the official version is now in the hands of mathematicians).  Toggle it on when reasoning through complex scientific literature, tackling a coding problem that requires careful consideration of time complexities - or anything else @DemisHassabis considers a fun Friday night:)

Can testify that this is an amazing team to work for, filled with insanely talented yet humble researchers and engineers!

Very excited to share that an advanced version of Gemini Deep Think is the first to have achieved gold-medal level in the International Mathematical Olympiad! 🏆, solving five out of six problems perfectly, as verified by the IMO organizers! It’s been a wild run to lead this effort and I am grateful to everyone in the team for such an amazing achievement! Blog post in the thread and more to share soon!

Very excited to share that @windsurf_ai co-founders @_mohansolo & Douglas Chen, and some of their talented team have joined @GoogleDeepMind to help advance our work in agentic coding in Gemini. Welcome to our new team mates from Windsurf! theverge.com/openai/705999/g…

Today I'm launching my new company @GeneralAgentsCo and our first product. Introducing Ace: The First Realtime Computer Autopilot Ace is not a chatbot. Ace performs tasks for you. On your computer. Using your mouse and keyboard. At superhuman speeds!

One more landmark release... Today, @udiomusic released Style References. I used one of my past songs, 'The Chant, ' as a style to generate more songs like it. This is not a cover or remix but a new and unique approach. The quality and the emotion are incredible:

Special shout-out to Pablo, whose research made this possible, and to our engineering team, who worked night and day to release this feature!

Ever struggle to describe the song in your head? Meet Styles — a brand new feature that allows you to create new songs using an existing song or audio clip as a style reference. Rather than wrestling with text prompts to try to capture a vibe, now you can simply show Udio exactly what you’re looking for.

Meet v1.5 Allegro ⚡Allegro is the same v1.5 model that you know and love, distilled so that it can produce better quality songs faster. To be clear, this is not a new model generation. It’s just one exciting byproduct of some foundational modeling research that our team’s been conducting, which we’ve decided to share for free with all users starting today. The original v1.5 model will still be available, but v1.5 Allegro will be the new default.

This is pretty amazing work, always wanted to see a diffusion language model in action!

People would be shocked to learn how many "organic" posts about AI tools are undisclosed ads. I get several DMs a week asking my rates for a post or thread - some from tools you'd know! And they don't do their research...they're often competitors of my portfolio companies 🫠

Our amazing product manager Ian demonstrating how to edit songs on @udiomusic. It's a really powerful tool--I use it more than extensions myself. youtube.com/watch?v=Uc4xOZWK…

Making music is really fun, whether on instruments or using the latest technology. Glad that you are enjoying music creation with @udiomusic!

Devastatingly, we have lost a bright light in our field. Felix Hill was not only a deeply insightful thinker -- he was also a generous, thoughtful mentor to many researchers. He majorly changed my life, and I can't express how much I owe to him. Even now, Felix still has so much to give -- to all of us. Below, I've compiled some of his writings that I think would be inspiring to anyone in the field. They reflect his unusual perspective, his incisive writing, and his irreverent, witty sense of humor. It's a pleasure and an epiphany to read any of these. I hope this is a small way to help ensure that Felix's light continues to shine, as it deserves to -- 1. Why do transformers work so well on language? (bit.ly/4h1IbeR) Atypically few jokes in this one, but starting around 0:32:00 Felix answers a fundamental question that I've never seen addressed so well. He ties the architectural properties of the transformer 1:1 to properties of language. I think this perspective is so illuminating and incredibly underappreciated. 2. What deep learning can teach us about linguistics and science (bit.ly/4gGFmzZ). It starts with a pretty entertaining refutal of Chomskian linguistics, and then dives into an optimistic and pretty irrefutable argument about why neural networks can teach us about language. 3. How to write a paper (bit.ly/40698qO). One of many things I learned from Felix -- he taught me to put together a research story from the beginning, including imagined results. This narrative helps guide the research, even if the story might change with each new set of experiments. 4. The bittersweet lesson (bit.ly/3BLsEky). Felix wrote this a few weeks before he died, and it's a unique, insightful take on the bitter lesson. He asked for feedback but sadly I got overwhelmed with other things and it stayed on my todo list for too long.. I didn't get to tell him what a beautiful essay I thought it was, and how much he still had to contribute... 5. Mental health in (AI) research (bit.ly/3BT3lwW). If you are struggling, please do reach out for help, and please do hold on. There may not always be a complete fix, but there are always ways to make things significantly better. I believe this from the bottom of my heart

Update: Felix's farewell letter was just published. I read each and every word. Sharing here with my big audience because it may literally save lives. Turns out that stress in AI only contributed a bit. Overdose of ketamine (psychedelic drug) was what pushed him over the edge. Quote: "Recklessly, I clearly took too much. Within a week or so I became acutely psychotic. After days of unspeakable behaviour that I have some partial memory of, I was committed involuntarily to a mental health ward for 4 weeks [...] I wish so much that I’d never taken the Ketamine, at least without medical supervision. Without that, I am sure I could have resolved the challenges around alcohol, ambition and being too self-centred." Our brain is a neural network of ~100T parameters. Do NOT try to finetune those weight matrices with casual use of drugs! Similar to "loss spikes" in LLM training, one wrong gradient step may take you to an alien mental land of overwhelming, 24/7 torture; and unlike LLMs, you cannot roll back to an earlier checkpoint. No experiments is worth the risk. Quote: "Please if you have any voice, try to warn the public that drugs like Ketamine, which have important applications in treating mental illness, can have a notable side effect if used the wrong way -- to end a promising life and destroy multiple families, pretty much overnight. And it is a very slow and painful death." This is the least I can do to amplify Felix's last wish. I cannot begin to fathom that in his excruciating pain, Felix mustered every ounce of his being to write down his stories, struggles, and hope that others might be spared from the same fate. Felix didn’t owe the world an apology — yet he gave one. He didn’t need to offer his gratitude — yet he did. It is a testament to the depth of his kindness. Even in his final moment, he thought not only of his pain but of others, just like his research influenced a generation of scientists like myself. Link to doc in the thread. Be mindful: it is very, very emotional to read. Stay safe.

Felix Hill was a wonderful human being. He was, not only extremely intelligent, creative and passionate, but also very helpful and kind at work. He had a very special thoughtful mind - the rare kind that I’ve learned to deeply appreciate. Beyond work, he brought fun, joy and happiness to others, including myself on many occasions. I was amazed at his passion for helping with education in Latin America, and his ability for learning to deliver lectures in Spanish. He was a true champion of inclusion in AI. @_LXAI @Khipu_AI May he rest in peace, and may his words provide us with a beacon in these stormy waters. medium.com/@felixhill/200bn-…

I’m incredibly sad to hear about the passing of @FelixHill84. I’ve had the pleasure of working closely with Felix for my first NeurIPS paper and several subsequent projects. In addition to being a brilliant researcher, Felix was kind and humble, always making time to give me advice. He was a great mentor, and I’ve learned so much from him. Rest in peace, Felix.