AI Research Scientist

Joined March 2013
11 Photos and videos
Tim Salimans retweeted
🚀 Excited to share my @GoogleDeepMind student researcher project: Dual-Rate Diffusion✨ ⚡ A simple construction that speeds up both regular diffusion and distilled models by interleaving a heavy context encoder with a light conditional denoiser. 🧵👇
6
29
192
17,170
Tim Salimans retweeted
New blog post on our recent paper: Beyond Single Tokens, Distilling Discrete Diffusion. D-MMD lands on the Pareto frontier of gen PPL vs. diversity, outperforming continuous diffusion distillation approaches — while staying native to discrete tokens. ehoogeboom.github.io/post/di…
2
14
111
15,755
Touching down now in SF for onboarding at Anthropic! After 7 great years at Google, I'm excited to take on a new challenge and help make Claude even better. Grateful for everything I learned at Google DeepMind and Brain, looking forward to what's next.
65
17
1,184
257,883
Myth: Discrete diffusion models are naturally fast out of the box. 🤔 Reality: Naive sampling is actually quite slow and inefficient. 🐢 Solution: In our new paper, we show how the right step distillation technique unlocks massive speedups. ⚡️👇
You may think discrete distillation is fundamentally flawed, you are (surprisingly) wrong. 🤯 Meet Discrete Moment Distillation (D-MMD). It is a new method that brings fast, few-step sampling to discrete diffusion models! 🧵👇
11
73
30,018
VAEs are back! 🚀 By co-training a diffusion prior with an encoder and diffusion decoder we obtain a powerful recipe for compressing visual data into a controllable number of bits. By modeling this VAE latent space we obtain SOTA results with smaller models and fewer FLOPs!
1/6 Introducing Unified Latents: what if your diffusion model's latents were measured in bits? Instead of relying on dimensionality reduction, we learn a latent AE with explicit bitrate control. Paper: arxiv.org/abs/2602.17270 @emiel_hoogeboom, @TimSalimans
2
30
335
34,338
Really awesome to see the full potential of real-time generative modeling being realized! Helping to enable this has been a driving goal of our research in efficient generative models for a long time!
What if you could not only watch a generated video, but explore it too? 🌐 Genie 3 is our groundbreaking world model that creates interactive, playable environments from a single text prompt. From photorealistic landscapes to fantasy realms, the possibilities are endless. 🧵
3
5
54
8,852
Tim Salimans retweeted
Veo 2 and the new Imagen 3 update just dropped. Amazing effort by the team!!
Today, we’re announcing Veo 2: our state-of-the-art video generation model which produces realistic, high-quality clips from text or image prompts. 🎥 We’re also releasing an improved version of our text-to-image model, Imagen 3 - available to use in ImageFX through @LabsDotGoogle. → goo.gle/veo-2-imagen-3
9
15
165
23,702
Are you a current PhD student working in generative modeling? Our team at GDM Amsterdam is looking to hire a student researcher / intern to help us develop the next generation of models. Apply before 𝐃𝐞𝐜𝐞𝐦𝐛𝐞𝐫 𝟏𝟑! google.com/about/careers/app…

1
13
97
16,918
On my way to Vancouver for NeurIPS. Looking forward to catching up with everyone and sharing the work we've been doing in making diffusion models fast and efficient!
1
53
8,798
Tim Salimans retweeted
2 Dec 2024
A common question nowadays: Which is better, diffusion or flow matching? 🤔 Our answer: They’re two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. That’s great: It means you can use them interchangeably.
16
199
945
172,685
Tim Salimans retweeted
Is pixel diffusion passé? In 'Simpler Diffusion' (arxiv.org/abs/2410.19324) , we achieve 1.5 FID on ImageNet512, and SOTA on 128x128 and 256x256. We ablated out a lot of complexity, making it truly 'simpler'. w/ @tejmensink @JonathanHeek @KayLamerigts @RuiqiGao @TimSalimans
13
62
366
54,516
Tim Salimans retweeted
We are hiring on the Generative Media team in London: boards.greenhouse.io/deepmin… We work on Imagen, Veo, Lyria and all that good stuff. Come work with us! If you're interested, don't delay -- apply before 5PM tomorrow (UK time).
4
40
257
52,484
Tim Salimans retweeted
11 Jul 2024
🚀 Interested in time series generation?⏲️Excited to share my @GoogleDeepMind Amsterdam student researcher project: Rolling Diffusion Models! arxiv.org/abs/2402.09470 (to appear at ICML 2024) Thanks for the great collaboration @emiel_hoogeboom, @JonathanHeek, @TimSalimans! 🧵1/4
11
52
323
28,973
We have a new distillation method that actually *improves* upon its teacher. Moment Matching distillation (arxiv.org/abs/2406.04103) creates fast stochastic samplers by matching data expectations between teacher and student. Work with @emiel_hoogeboom @JonathanHeek @tejmensin. 1/4
7
33
191
20,969
oops dropped a k there: That's my highly valued colleague Thomas Mensink @tejmensink of course!
6
1,298
A unique advantage of our method compared to previous approaches (consistency models, Diff-Instruct, DMD, GANs), is that the moment matching perspective gives us a well-defined loss function we can use to monitor progress and convergence of the distillation algorithm. 4/4
1
2
9
1,753
5/4 If this sounds interesting, come find me at CVPR, where on June 17th I'll be giving several talks on this and other work our team has been doing!
1
5
1,160
My team in Amsterdam is hiring a research scientist with experience in generative modeling. Please apply if you want to help us build the next generation of Google's generative models! boards.greenhouse.io/deepmin…
1
26
199
56,780