๐ Weโre excited to announce our paper Depth Any Camera (DAC), accepted to ๐๐ฉ๐ฃ๐ฅ ๐ฎ๐ฌ๐ฎ๐ฑ! ๐
Along with this, we have a few exciting updates!
To support NeRF & Gaussian Splatting on fisheye inputs, we now provide DACโs depth estimation results for #ZipNeRF on fisheye images.
๐ฅ Download depth maps:
๐ yuliangguo.github.io/depth-aโฆ
Methods like #SMERF, #FisheyeGS, & #EVER can leverage this fisheye depth prior!
#CVPR2025#NeRF#GaussianSplatting#3DReconstruction#ComputerVision
๐งAlso, check out our library nvTorchCam, built for seamless PyTorch workflows across pinhole, fisheye, ERP, and other camera models.
๐ป github.com/NVlabs/nvTorchCam
๐ Introducing ProJo4D โ a new method for Inverse Physics estimation: recovering 3D shape and physical behavior of deformable objects.
It can simulate future motion and render novel views โ all from sparse multi-view videos!
๐ daniel03c1.github.io/ProJo4Dโฆ
๐ Thrilled to introduce nvTorchCam, our new #PyTorch library designed to support the development of models using camera geometry like plane-sweep volumes (PSV) and related concepts like sphere-sweep volumes or epipolar attention, in a camera model-agnostic way! ๐
๐ Code: github.com/NVlabs/nvTorchCam
(1/6)
Proud of this project led by @daniel_lichy. FoVA-Depth is our answer to a problem we experience in many projects: for uncommon cameras, eg fisheye, we don't have as much training depth data as we do for pinhole cameras.
๐ Ready to take 3D reconstruction to the next level? Whether you're working on NeRF or 3DGS, our new method, GLOMAP, is here to impress! ๐ It's faster and more accurate than COLMAP on several datasets.
๐ Website: lpanaf.github.io/eccv24_glomโฆ@mapo1, @LinfeiPan, J. Schรถnberger
๐ ๏ธ Also, check out our nvTorchCam library at github.com/NVlabs/nvTorchCam. It offers tools for building cost-volumes for various camera models. I hope our FoVA-Depth methods will soon be applied in new technologies, such as generalizable #GaussianSplatting techniques like MVSGaussian mvsgaussian.github.io/ โจ (7/8)
Accepted to #ECCV2024, version 2 of our past 'Accidental Light Stage' work (grail.cs.washington.edu/projโฆ). We can perform real-time temporally consistent relighting by using monitor relighting in any condition (*as long as the monitor light has some relative strength).
๐ขNew research from our group
โPersonalized Video Relighting with an At-Home Light Stageโ
(1/3) We show how to leverage screen lighting as an 'at-home Light Stage' and develop a personalized relighting model. We can now replace your background and relight your faces to match it!
๐ขDoing 3D learning on datasets captured with different camera/image models, eg a mix of pinholes and fisheyes or ERPs?
With #nvTorchCam write the code once and forget about it, and you can even batch them all together!
github.com/NVlabs/nvTorchCam
Let us know what you think!
๐ Thrilled to introduce nvTorchCam, our new #PyTorch library designed to support the development of models using camera geometry like plane-sweep volumes (PSV) and related concepts like sphere-sweep volumes or epipolar attention, in a camera model-agnostic way! ๐
๐ Code: github.com/NVlabs/nvTorchCam
(1/6)
๐ Thrilled to introduce nvTorchCam, our new #PyTorch library designed to support the development of models using camera geometry like plane-sweep volumes (PSV) and related concepts like sphere-sweep volumes or epipolar attention, in a camera model-agnostic way! ๐
๐ Code: github.com/NVlabs/nvTorchCam
(1/6)
๐ Fully differentiable and packed with practical examples, nvTorchCam is ready to enhance your research or project. Check out our examples and see how it integrates into your workflow.
(4/6)