Research Scientist @GoogleDeepMind

Joined March 2021
4 Photos and videos
Pinned Tweet
Replying to @GoogleMagenta
We had so much fun building MRT2.  Proud to see it go live.  Here's a chord steering example.  Name that tune anyone?
1
24
4,398
Noah Constant retweeted
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
21
95
492
109,133
Noah Constant retweeted
Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶 Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026. We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license. 💾 Get it here: github.com/magenta/the-infin…
9
43
207
20,642
Noah Constant retweeted
Magenta is hiring student researchers for 2026! We're looking for candidates to push the boundaries of interactive real-time music generation, such as the next generation of Lyria RealTime and Magenta RealTime models. Follow instructions to apply here: forms.gle/EAvTt1KLNqpVHx9h7

15
79
51,726
Noah Constant retweeted
We built a web app that lets you fly a spaceship through a 3D constellation of music - powered by our Lyria RealTime model. 🎶 Space DJ is an interactive visualization where every star represents a different music genre. As you explore, your path is translated into prompts for the API, creating a continuously evolving soundtrack. ↓
94
270
1,946
280,187
Made a walkthrough vid for Magenta RealTime “Audio Injection”! The notebook takes ~10m to spin up, but totally worth it for the surreal experience 🎤💻🎧⁉️
2
14
63
10,763
Would love to see this combined with fine-tuned models for more personalized results. colab.research.google.com/gi…
1
7
291
We’re just getting started with live music models. Can’t wait to see the possibilities for musicians of any skill level to craft, shape, layer their sound in real time.
7
243
Noah Constant retweeted
Everyone talks about real-time AI for speech but sleeps on it for music Real-time is nice to have for conversations, but essential for co-jamming
Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
1
7
38
3,619
Noah Constant retweeted
17 Aug 2025
Replying to @jesseengel
Hours and hours of fun and inspiration. Tiny excerpt: youtube.com/shorts/53gmT8zaf…

1
4
1,397
Noah Constant retweeted
🔊 Easy to lose hours to live jamming w/ Magenta RT. Feels like a glimpse at something magical Try it yourself! Some setup involved (we're working on improving that!) but worth it: g.co/magenta/rt-audio-inject…
6
19
111
9,595
Noah Constant retweeted
In 2018, we wrote a paper titled "the challenge of realistic music generation". A few years ago, this challenge was essentially solved: it is now a thing that exists🤯 Realtime is the next frontier, it opens up so many more possibilities. There's a tech report open weights!🙏
Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
4
15
102
11,315
Noah Constant retweeted
I’m happy to have donated my voice to this incredible new open model and instrument! It is a new, active, approach to spawning music, made for real time jamming and exploration. More like a sampler than a jukebox, you can fine tune it on your own sounds and soon run it locally!
We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain
3
16
94
10,815
Noah Constant retweeted
We've worked with @hollyherndon and @matdryhurst to finetune Magenta RT on Holly's vocals and the result is a really cool model that keeps the base model's ability to respond to wide-ranging controls while infusing outputs with the unique sonic qualities of the finetuning domain
Replying to @jesseengel
We're thrilled to have worked with Holly Herndon to train a model finetuned on her vocal style to share with all of you. Playing with Holly’s model, you can use additional controls to get vocalizations that contour the music or "color" the instruments with a timbre that resembles Holly's voice
3
12
69
21,913
Noah Constant retweeted
Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
81
169
1,103
183,334
Noah Constant retweeted
New VST/AU Plugin! 🚨 Play with Lyria RealTime directly from inside your favorite DAW with “The Infinite Crate” 🎧🎶 Like other Lyria RT demos, you can mix together text prompts and other controls to steer the model in real-time. But now with a VST plugin you can feed audio directly into your DAW for sampling, live performance, or even a practice partner to jam with. 💾 Get it here: g.co/magenta/infinite-crate
14
32
187
59,834
Noah Constant retweeted
We’ve just released Magenta RealTime, an open-weights live music model that lets you craft sounds in real time by exploring the latent space through text and audio! 🤗 Model: huggingface.co/google/magent…… 🧑‍💻Code: github.com/magenta/magenta-r… 📝Blog post: magenta.withgoogle.com/magen…
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi… 👀 Blog post: g.co/magenta/rt 🧵 below
6
17
96
7,221
Noah Constant retweeted
20 Jun 2025
🎸🥁🎹🎵 New open weights music model from Magenta for real-time generation. Excited to see what cool instruments you all can make with it 🙂
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi… 👀 Blog post: g.co/magenta/rt 🧵 below
3
6
54
2,791
Noah Constant retweeted
20 Jun 2025
Introducing Magenta RealTime, our open weights live music model! Like Lyria RealTime, this model provides the user continuous control of the musical flow 🌊. We will be sharing some of our favorite ways to extend these models over the next few weeks. Can't wait to see what you do!
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control. 👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi… 👀 Blog post: g.co/magenta/rt 🧵 below
18
10
126
16,042