📢Thrilled to share that I'll be joining Harvard and the Kempner Institute as an Assistant Professor starting Fall 2026! I'll be recruiting students this year for the Fall 2026 admissions cycle. Hope you apply!

📢Excited to share that I’ve joined @MBZUAI as an Assistant Professor of Computer Vision this fall! If you’re interested in CV4Science: building the next generation of foundation models & discovery tools for science, consider applying to MBZUAI. I’ll be recruiting PhD students!

After a year of severe injury and complex surgery, I wrote about my journey—physical, emotional, and everything in between—hoping it might help others feel less alone in their own recovery. tender-aster-768.notion.site…

These demos look so amazing!

Congrats to my great roommate during PhD, who got best paper award when I was still trying to figure out how to write an organized vision paper 😆 Yucheng is so nice, kind, and have so much passion and insights on research. I cannot imagine how lucky his first batch students are

Really cool work on using MLLM to analyze city-scale image collection and automatically find the changes over time. Really curious to see all the interesting findings discovered by it!

really cool work and demo！

github.com/NVIDIA/Cosmos Cosmos is a developer-first platform designed to help physical AI builders accelerate their development. It has pre-trained world foundation models (diffusion & autoregressive) in different sizes and video tokenizers. They are open models with permissive licenses. Try it out, and let us know how we can better help.

and also check out paper, which might be the first wave to explore this idea, "Diffusion Models Without Attention" (arxiv.org/abs/2311.18257) with @thoma_gu and @srush_nlp.

Why can’t more non-Chinese researchers show even a bit care about the racism against Chinese students in the NeurIPS keynote? Why can’t more US researchers pay any attention to the suffering of international students? I remain very disappointed, esp. at many established people.

Interesting recording. And thanks to the audience for confronting straightforward!

Apparently, this is called “cultural generalization” according to #NeurIPS2024 . Never too old to learn something new.

Cultural generalization? Come on bro

Really cool work on getting diffusion features directly from clean images!

This looks so cool!

Amazing results 🤩

I am on the job market for industry and academic roles. My research focuses identifying, designing, and building efficient, scalable, sustainable, and affordable abstractions and infrastructure for generative modeling research. I also minor law, and do AI policy work.

Really cool work on 3D consistent video generation!

Curious whether video generation models (like #SORA) qualify as world models? We conduct a systematic study to answer this question by investigating whether a video gen model is able to learn physical laws. Three are three key messages to take home: 1⃣The model generalises perfectly for in-distribution data, but fails to do out-of-distribution generalization. For combinatorial scenarios, scaling law is observed. 2⃣The models fail to abstract general rules and instead tries to mimic the closest training example. 3⃣The model prioritizes different attributes when referencing training data: color > size > velocity > shape. This work is a joint effort with our outstanding intern @YangYue_THU. Paper: arxiv.org/abs/2411.02385 Webpage: phyworld.github.io/

🎉 New work on ARC-AGI: We achieved open model SOTA by finetuning Llama3-8B on synthetically generated ARC-like problems! Our method: Prompting LLMs to create both (1) input grid generators and (2) input-output transformations in Python to create problems grounded in code!