Timezone: »
Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the generated radiance fields of existing frameworks are not directly editable, limiting their applicability in downstream tasks. We propose a solution to these challenges by developing a 3D GAN framework that learns to generate radiance fields of human bodies or faces in a canonical pose and warp them using an explicit deformation field into a desired body pose or facial expression. Using our framework, we demonstrate the first high-quality radiance field generation results for human bodies. Moreover, we show that our deformation-aware training procedure significantly improves the quality of generated bodies or faces when editing their poses or facial expressions compared to a 3D GAN that is not trained with explicit deformations.
Author Information
Alexander Bergman (Stanford University)
Petr Kellnhofer (Delft University of Technology)
Wang Yifan (Stanford University)
Eric Chan (Stanford University)
David Lindell (Department of Computer Science, University of Toronto)
Gordon Wetzstein (Stanford University)
More from the Same Authors
-
2022 Poster: Residual Multiplicative Filter Networks for Multiscale Reconstruction »
Shayan Shekarforoush · David Lindell · David Fleet · Marcus Brubaker -
2022 : Learning Controllable Adaptive Simulation for Multi-scale Physics »
Tailin Wu · Takashi Maruyama · Qingqing Zhao · Gordon Wetzstein · Jure Leskovec -
2022 : Heterogeneous reconstruction of deformable atomic models in Cryo-EM »
Youssef Nashed · Ariana Peck · Julien Martel · Axel Levy · Bongjin Koo · Gordon Wetzstein · Nina Miolane · Daniel Ratner · Frederic Poitevin -
2023 Poster: Transient Neural Radiance Fields for Lidar View Synthesis and 3D Reconstruction »
Anagh Malik · Parsa Mirdehghan · Sotiris Nousias · Kyros Kutulakos · David Lindell -
2023 Poster: Template-free Articulated Neural Point Clouds for Reposable View Synthesis »
Lukas Uzolas · Elmar Eisemann · Petr Kellnhofer -
2022 Spotlight: Residual Multiplicative Filter Networks for Multiscale Reconstruction »
Shayan Shekarforoush · David Lindell · David Fleet · Marcus Brubaker -
2022 Spotlight: Lightning Talks 5B-1 »
Devansh Arpit · Xiaojun Xu · Zifan Shi · Ivan Skorokhodov · Shayan Shekarforoush · Zhan Tong · Yiqun Wang · Shichong Peng · Linyi Li · Ivan Skorokhodov · Huan Wang · Yibing Song · David Lindell · Yinghao Xu · Seyed Alireza Moazenipourasil · Sergey Tulyakov · Peter Wonka · Yiqun Wang · Ke Li · David Fleet · Yujun Shen · Yingbo Zhou · Bo Li · Jue Wang · Peter Wonka · Marcus Brubaker · Caiming Xiong · Limin Wang · Deli Zhao · Qifeng Chen · Dit-Yan Yeung -
2022 Poster: NeuForm: Adaptive Overfitting for Neural Shape Editing »
Connor Lin · Niloy Mitra · Gordon Wetzstein · Leonidas Guibas · Paul Guerrero -
2022 Poster: Amortized Inference for Heterogeneous Reconstruction in Cryo-EM »
Axel Levy · Gordon Wetzstein · Julien N.P Martel · Frederic Poitevin · Ellen Zhong -
2021 : Gordon Wetzstein Talk »
Gordon Wetzstein -
2021 Poster: Fast Training of Neural Lumigraph Representations using Meta Learning »
Alexander Bergman · Petr Kellnhofer · Gordon Wetzstein -
2020 Poster: Implicit Neural Representations with Periodic Activation Functions »
Vincent Sitzmann · Julien N.P Martel · Alexander Bergman · David Lindell · Gordon Wetzstein -
2020 Poster: MetaSDF: Meta-Learning Signed Distance Functions »
Vincent Sitzmann · Eric Chan · Richard Tucker · Noah Snavely · Gordon Wetzstein -
2020 Oral: Implicit Neural Representations with Periodic Activation Functions »
Vincent Sitzmann · Julien N.P Martel · Alexander Bergman · David Lindell · Gordon Wetzstein -
2019 Poster: Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations »
Vincent Sitzmann · Michael Zollhoefer · Gordon Wetzstein -
2019 Oral: Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations »
Vincent Sitzmann · Michael Zollhoefer · Gordon Wetzstein