Timezone: »
We address the novel task of jointly reconstructing the 3D shape, texture, and motion of an object from a single motion-blurred image. While previous approaches address the deblurring problem only in the 2D image domain, our proposed rigorous modeling of all object properties in the 3D domain enables the correct description of arbitrary object motion. This leads to significantly better image decomposition and sharper deblurring results. We model the observed appearance of a motion-blurred object as a combination of the background and a 3D object with constant translation and rotation. Our method minimizes a loss on reconstructing the input image via differentiable rendering with suitable regularizers. This enables estimating the textured 3D mesh of the blurred object with high fidelity. Our method substantially outperforms competing approaches on several benchmarks for fast moving objects deblurring. Qualitative results show that the reconstructed 3D mesh generates high-quality temporal super-resolution and novel views of the deblurred object.
Author Information
Denys Rozumnyi (ETH Zurich)
Martin R. Oswald (ETH Zurich)
Vittorio Ferrari (Google)
Marc Pollefeys (ETH Zurich)
More from the Same Authors
-
2021 Oral: Shape As Points: A Differentiable Poisson Solver »
Songyou Peng · Chiyu Jiang · Yiyi Liao · Michael Niemeyer · Marc Pollefeys · Andreas Geiger -
2021 Poster: Shape As Points: A Differentiable Poisson Solver »
Songyou Peng · Chiyu Jiang · Yiyi Liao · Michael Niemeyer · Marc Pollefeys · Andreas Geiger -
2019 Poster: Reflection Separation using a Pair of Unpolarized and Polarized Images »
Youwei Lyu · Zhaopeng Cui · Si Li · Marc Pollefeys · Boxin Shi -
2019 Spotlight: Reflection Separation using a Pair of Unpolarized and Polarized Images »
Youwei Lyu · Zhaopeng Cui · Si Li · Marc Pollefeys · Boxin Shi -
2017 Poster: Matching neural paths: transfer from recognition to correspondence search »
Nikolay Savinov · Lubor Ladicky · Marc Pollefeys -
2012 Poster: Globally Convergent Dual MAP LP Relaxation Solvers using Fenchel-Young Margins »
Alex Schwing · Tamir Hazan · Marc Pollefeys · Raquel Urtasun -
2010 Poster: Gated Softmax Classification »
Roland Memisevic · Christopher Zach · Geoffrey E Hinton · Marc Pollefeys