Skip to yearly menu bar Skip to main content


Poster

HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors

Panwang Pan · Zhuo Su · Chenguo Lin · Zhen Fan · Yongjie Zhang · Zeming Li · Tingting Shen · Yadong Mu · Yebin Liu


Abstract:

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle these issues, we present HumanSplat which predicts 3D Gaussian Splatting properties of any unseen human body from a single input image in a generalizable manner. In particular, HumanSplat is composed of a 2D multi-view diffusion model and a latent reconstruction transformer with human structure priors that adeptly integrate geometric priors and semantic features within a unified framework. A hierarchical loss that incorporates human semantic priors is designed to achieve high-fidelity texture modeling and better constrain the estimated multiple views. Comprehensive experiments on standard benchmarks, such as Thuman2.0 datasets demonstrate that HumanSplat surpasses existing state-of-the-art methods in achieving photorealistic novel-view synthesis.

Live content is unavailable. Log in and register to view live content