Timezone: »
Most state-of-the-art deep geometric learning single-view reconstruction approaches rely on encoder-decoder architectures that output either shape parametrizations or implicit representations. However, these representations rarely preserve the Euclidean structure of the 3D space objects exist in. In this paper, we show that building a geometry preserving 3-dimensional latent space helps the network concurrently learn global shape regularities and local reasoning in the object coordinate space and, as a result, boosts performance.
We demonstrate both on ShapeNet synthetic images, which are often used for benchmarking purposes, and on real-world images that our approach outperforms state-of-the-art ones. Furthermore, the single-view pipeline naturally extends to multi-view reconstruction, which we also show.
Author Information
Benoit Guillard (EPFL)
Edoardo Remelli (EPFL)
Pascal Fua (EPFL, Switzerland)
More from the Same Authors
-
2021 : SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation »
Robin Chan · Krzysztof Lis · Svenja Uhlemeyer · Hermann Blum · Sina Honari · Roland Siegwart · Pascal Fua · Mathieu Salzmann · Matthias Rottmann -
2020 Poster: DISK: Learning local features with policy gradient »
Michał Tyszkiewicz · Pascal Fua · Eduard Trulls -
2020 Poster: MeshSDF: Differentiable Iso-Surface Extraction »
Edoardo Remelli · Artem Lukoianov · Stephan Richter · Benoit Guillard · Timur Bagautdinov · Pierre Baque · Pascal Fua -
2020 Spotlight: DISK: Learning local features with policy gradient »
Michał Tyszkiewicz · Pascal Fua · Eduard Trulls -
2020 Spotlight: MeshSDF: Differentiable Iso-Surface Extraction »
Edoardo Remelli · Artem Lukoianov · Stephan Richter · Benoit Guillard · Timur Bagautdinov · Pierre Baque · Pascal Fua -
2019 Demonstration: Real Time CFD simulations with 3D Mesh Convolutional Networks »
Pierre Baque · Pascal Fua · François Fleuret -
2019 Poster: Backpropagation-Friendly Eigendecomposition »
Wei Wang · Zheng Dang · Yinlin Hu · Pascal Fua · Mathieu Salzmann -
2018 Poster: LF-Net: Learning Local Features from Images »
Yuki Ono · Eduard Trulls · Pascal Fua · Kwang Moo Yi -
2017 Poster: Learning Active Learning from Data »
Ksenia Konyushkova · Raphael Sznitman · Pascal Fua -
2015 Poster: Kullback-Leibler Proximal Variational Inference »
Mohammad Emtiyaz Khan · Pierre Baque · François Fleuret · Pascal Fua -
2013 Poster: Non-Linear Domain Adaptation with Boosting »
Carlos J Becker · Christos M Christoudias · Pascal Fua