AnimatableGaussians source code released! github.com/lizhe00/Animatabl…

We have build a code repository of our group projects and made public some source codes, including the latest works of DreamCraft3D, GPS-Gaussian, HumanNorm, and HAvatar. See: github.com/thu3dhuman

It is truly Christmas today: More code dropped: "GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis" github.com/ShunyuanZheng/GPS…

Gaussian Splatting relies on per-frame parameter optimizations for several minutes. Our generalizable pixel-wise 3D Gaussian Splatting enable instantly and realtime rendering without necessitating any fine-tuning or optimization for an unseen character. shunyuanzheng.github.io/GPS-…

Thrilled to share my latest work, Control4D! 🌟 This groundbreaking paper introduces advanced human editing capabilities, all in 4D space. Control4D sets new standards in quality, efficiency, and consistency for 4D editing. Imagine creating fun and unique effects, like some famous tech CEOs grilling in a leather jacket, or pouring coffee – the possibilities are endless. Transform into your favorite superhero, wear elf king's silver armor, or have a digital meet-and-greet with a star. All of this is happening in a 4D scene within several minutes! Check out our project page at control4darxiv.github.io/ for more exciting details.

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling Projectpage: animatable-gaussians.github.…

DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior paper page: huggingface.co/papers/2310.1… present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture boosting. A central focus of this work is to address the consistency issue that existing works encounter. To sculpt geometries that render coherently, we perform score distillation sampling via a view-dependent diffusion model. This 3D prior, alongside several training strategies, prioritizes the geometry consistency but compromises the texture fidelity. We further propose Bootstrapped Score Distillation to specifically boost the texture. We train a personalized diffusion model, Dreambooth, on the augmented renderings of the scene, imbuing it with 3D knowledge of the scene being optimized. The score distillation from this 3D-aware diffusion prior provides view-consistent guidance for the scene. Notably, through an alternating optimization of the diffusion prior and 3D scene representation, we achieve mutually reinforcing improvements: the optimized 3D scene aids in training the scene-specific diffusion model, which offers increasingly view-consistent guidance for 3D optimization. The optimization is thus bootstrapped and leads to substantial texture boosting. With tailored 3D priors throughout the hierarchical generation, DreamCraft3D generates coherent 3D objects with photorealistic renderings, advancing the state-of-the-art in 3D content generation.

Now we release the source code of Next3D at github.com/MrTornado24/Next3…. Welcome to have a try😀

Our new Siggaph Asia 2022 paper proposes a real-time 3D-aware face editing framework that supports high-fidelity 3D face style editing. mrtornado24.github.io/IDE-3D…

Our new Siggaph Asia 2022 paper proposes a real-time 3D-aware face editing framework that supports high-fidelity facial synthesis and fine-grained style editing of shape and appearance. mrtornado24.github.io/IDE-3D…

Demo code for PyMAF-X is now released on GitHub. 👏👏Please check out the new branch of PyMAF: github.com/HongwenZhang/PyMA… Issues, pull requests, and discussions are welcome! 😃

Source code (including training code) public at: github.com/jsnln/fite #ECCV2022 Learning Implicit Templates for Point-Based Clothed Human Modeling jsnln.github.io/fite/

#ECCV2022 (Oral) Diffusion model is also good at stereo matching! We show high quality human reconstruction using only 8 cameras, by learning diffuse stereo matching on human scan datasets. Video demo uploaded on webpage: liuyebin.com/diffustereo/dif…

#ECCV2022(Oral). Diffusion model is also good at stereo matching! In this work, by learning diffusion stereo matching on the high quality human scan datasets, we achieve high quality reconstruction using only 8 camera views on real world data. Project: liuyebin.com/diffustereo/dif…

#ECCV2022. Diffusion model is also good at stereo matching! By learning diffusion stereo matching on the human scan datasets, we achieve extremely high quality reconstruction using only 8 RGB views. Results on synthetic dataset: Project: liuyebin.com/diffustereo/dif…

Thanks for sharing this😃 I couldn't even believe PyMAF can perform so well😅

#ECCV2022 This works solves two challenges in e Single-image Full-body Human Relighting: (i) inability to disambiguate albedo and lighting (ii) inability to model high-frequency shadows due to reliance on Spherical harmonics representation of lighting. jcn16.github.io/jcn.github.i…

#ECCV2022 FITE: A First-Implicit-Then-Explicit framework for modeling humans in clothing. Leveraging both implicit and explicit representations, FITE produces more expressive clothing details and achieves better geometric continuity. project page: jsnln.github.io/fite/

PyMAF-X is coming!👋👏👏 As an eXpressive extension, PyMAF-X supports full-body mesh recovery and inherits all the properties and merits of PyMAF: monocular-input, regression-based, more robust, and better aligned. arXiv: arxiv.org/abs/2207.06400 Project: hongwenzhang.github.io/pymaf…

PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Images arxiv:arxiv.org/abs/2207.06400 project:hongwenzhang.github.io/pymaf…