Timezone: »

 
Spotlight
Neural Shape Deformation Priors
Jiapeng Tang · Lev Markhasin · Bi Wang · Justus Thies · Matthias Niessner

Thu Dec 08 05:00 PM -- 07:00 PM (PST) @
in Lightning Talks 6A-3 »

We present Neural Shape Deformation Priors, a novel method for shape manipulation that predicts mesh deformations of non-rigid objects from user-provided handle movements. State-of-the-art methods cast this problem as an optimization task, where the input source mesh is iteratively deformed to minimize an objective function according to hand-crafted regularizers such as ARAP. In this work, we learn the deformation behavior based on the underlying geometric properties of a shape, while leveraging a large-scale dataset containing a diverse set of non-rigid deformations. Specifically, given a source mesh and desired target locations of handles that describe the partial surface deformation, we predict a continuous deformation field that is defined in 3D space to describe the space deformation. To this end, we introduce transformer-based deformation networks that represent a shape deformation as a composition of local surface deformations. It learns a set of local latent codes anchored in 3D space, from which we can learn a set of continuous deformation functions for local surfaces. Our method can be applied to challenging deformations and generalizes well to unseen deformations. We validate our approach in experiments using the DeformingThing4D dataset, and compare to both classic optimization-based and recent neural network-based methods.

Keywords: shape editing · Shape manipulation · Shape Deformation · Geometric processing · Deformation Fields

Author Information

Jiapeng Tang (Technische Universität München)
Jiapeng Tang

Jiapeng Tang is a Ph.D. student at the Visual Computing Lab advised by Prof. Matthias Nießner. My research focuses on understanding and reconstructing dynamic 3D environments. Previously, I received his Bachelor and Master degrees in Electronic Engineering at South China University of Technology.

Lev Markhasin (Sony Europe RDC Stuttgart)
Bi Wang (Technische Universität München)
Justus Thies (Max-Planck Institute for Intelligent Systems)
Matthias Niessner (Technical University of Munich)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors