Timezone: »
This work investigates the use of robust optimal transport (OT) for shape matching. Specifically, we show that recent OT solvers improve both optimization-based and deep learning methods for point cloud registration, boosting accuracy at an affordable computational cost. This manuscript starts with a practical overview of modern OT theory. We then provide solutions to the main difficulties in using this framework for shape matching. Finally, we showcase the performance of transport-enhanced registration models on a wide range of challenging tasks: rigid registration for partial shapes; scene flow estimation on the Kitti dataset; and nonparametric registration of lung vascular trees between inspiration and expiration. Our OT-based methods achieve state-of-the-art results on Kitti and for the challenging lung registration task, both in terms of accuracy and scalability. We also release PVT1010, a new public dataset of 1,010 pairs of lung vascular trees with densely sampled points. This dataset provides a challenging use case for point cloud registration algorithms with highly complex shapes and deformations. Our work demonstrates that robust OT enables fast pre-alignment and fine-tuning for a wide range of registration models, thereby providing a new key method for the computer vision toolbox. Our code and dataset are available online at: https://github.com/uncbiag/robot.
Author Information
Zhengyang Shen (Department of Computer Science, University of North Carolina, Chapel Hill)
Jean Feydy (Imperial College London)
Peirong Liu (University of North Carolina at Chapel Hill)
Computer Vision, Medical Imaging
Ariel H Curiale (Brigham and Women’s Hospital, Harvard Medical School - CONICET)
Ruben San Jose Estepar (Harvard University)
Raul San Jose Estepar (Harvard University)
Marc Niethammer (UNC Chapel Hill)
More from the Same Authors
-
2022 Poster: Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Language »
Zhenlin Xu · Marc Niethammer · Colin Raffel -
2022 Poster: On Measuring Excess Capacity in Neural Networks »
Florian Graf · Sebastian Zeng · Bastian Rieck · Marc Niethammer · Roland Kwitt -
2020 Poster: A shooting formulation of deep learning »
François-Xavier Vialard · Roland Kwitt · Susan Wei · Marc Niethammer -
2020 Oral: A shooting formulation of deep learning »
François-Xavier Vialard · Roland Kwitt · Susan Wei · Marc Niethammer -
2020 Poster: Fast geometric learning with symbolic matrices »
Jean Feydy · Alexis Glaunès · Benjamin Charlier · Michael Bronstein -
2020 Spotlight: Fast geometric learning with symbolic matrices »
Jean Feydy · Alexis Glaunès · Benjamin Charlier · Michael Bronstein -
2019 Poster: Region-specific Diffeomorphic Metric Mapping »
Zhengyang Shen · Francois-Xavier Vialard · Marc Niethammer -
2017 Poster: Deep Learning with Topological Signatures »
Christoph Hofer · Roland Kwitt · Marc Niethammer · Andreas Uhl -
2015 Poster: Statistical Topological Data Analysis - A Kernel Perspective »
Roland Kwitt · Stefan Huber · Marc Niethammer · Weili Lin · Ulrich Bauer