🎉 [CVPR 2025] ZeroMSF Code Release! 3D scene flow from a single camera, with no fine-tuning on new domains? That’s the challenge we tackled in Zero-MSF (Zero-shot Monocular Scene Flow). 💡 Motivation Scene flow captures both geometry and motion, but existing methods crumble when moving beyond their training set. We asked: Can we build a foundation-style model that generalizes—out of the box—to any scene? 🔬 Our Answer • Large-scale synthetic pre-training (1M dynamic samples) • A unified geometry-motion parameterization • Zero-shot inference on real-world videos—no extra training, just run it! 🤝 Huge Thanks To my brilliant collaborators AbhishekBadki, HangSu, @0razio and my amazing advisor @jtompkin for making this possible. 👉 Dive In: research.nvidia.com/labs/lpr…

Come and say 👋 tomorrow (06/13) for our oral (1pm, Karl Dean Ballroom) and poster sessions (4pm, ExHall D, #81)! #CVPR2025 @CVPR @CVPRConf @NVIDIAAIDev @NVIDIARobotics #NVIDIA

Heading to Nashville for @CVPR ! 🎸 I’ll be presenting the @nvidia internship project — “Zero-Shot Monocular Scene Flow Estimation in the Wild” (Best Paper Candidate) 🗓 Sunday, June 15 🕘 Poster Oral Presentation: Morning session 🔗 research.nvidia.com/labs/lpr… #ComputerVision #SceneFlow #NVIDIAResearch #3DVision #CVPR2025

Could #AI revolutionize stereo depth estimation? Utilizing a massive dataset of stereo pairs, FoundationStereo is designed as a foundation model with strong zero-shot generalization and automatic self-curation pipeline. Details from #NVIDIAResearch ➡️ nvlabs.github.io/FoundationS…

🚀 Excited to release the code from our #3DV2024 oral presentation: FoVA-Depth: Field-of-View Agnostic Depth Estimation for cross-dataset generalization! 📊 🔗 Project details: research.nvidia.com/labs/lpr… 🔗 Code: github.com/NVlabs/fova-depth (1/8)

🎉 Thrilled to introduce nvTorchCam, our new #PyTorch library designed to support the development of models using camera geometry like plane-sweep volumes (PSV) and related concepts like sphere-sweep volumes or epipolar attention, in a camera model-agnostic way! 🚀 🔗 Code: github.com/NVlabs/nvTorchCam (1/6)

All my CVPR papers have a female first author (and last author 😋)!! 🥳

Live footage of the entire world preparing for Nvidia’s earnings call

Neural LiDAR Fields for Novel View Synthesis abs: arxiv.org/abs/2305.01643 project page: research.nvidia.com/labs/tor…

In about a week @SIGGRAPH, we will showcase an AI-Mediated 3D Video Conference system at Emerging Technologies, where you can talk to people in 3D using only a webcam GenAI. It also features Live 3D Portrait and many more! Check it out nvidia.com/en-us/events/sigg…

We are hiring a Ph.D. intern @ NVIDIA for research on multi-modal generative models, reinforcement learning, self-supervised representations, and 3D perception for video conferencing. If you have experience leading insightful contributions on any of these topics, DM / email me.

📢Excited to announce "NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models"! research.nvidia.com/labs/tor… Joint work w/ the amazing @brad19brown @kangxue_yin @karsten_kreis @K_S_Schwarz @lidaiqing @robrombach @abtorralba @FidlerSanja @NVIDIAAI #CVPR2023