Timezone: »
In this paper, we comparatively analyze the Bures-Wasserstein (BW) geometry with the popular Affine-Invariant (AI) geometry for Riemannian optimization on the symmetric positive definite (SPD) matrix manifold. Our study begins with an observation that the BW metric has a linear dependence on SPD matrices in contrast to the quadratic dependence of the AI metric. We build on this to show that the BW metric is a more suitable and robust choice for several Riemannian optimization problems over ill-conditioned SPD matrices. We show that the BW geometry has a non-negative curvature, which further improves convergence rates of algorithms over the non-positively curved AI geometry. Finally, we verify that several popular cost functions, which are known to be geodesic convex under the AI geometry, are also geodesic convex under the BW geometry. Extensive experiments on various applications support our findings.
Author Information
Andi Han (University of Sydney)
Bamdev Mishra (Microsoft)
Pratik Kumar Jawanpuria (Microsoft)
Junbin Gao (University of Sydney)
More from the Same Authors
-
2021 : Wasserstein Adversarially Regularized Graph Autoencoder »
Huidong Liang · Junbin Gao -
2022 : Rieoptax: Riemannian Optimization in JAX »
Saiteja Utpala · Andi Han · Pratik Kumar Jawanpuria · Bamdev Mishra -
2020 : Poster Session 1 (gather.town) »
Laurent Condat · Tiffany Vlaar · Ohad Shamir · Mohammadi Zaki · Zhize Li · Guan-Horng Liu · Samuel Horváth · Mher Safaryan · Yoni Choukroun · Kumar Shridhar · Nabil Kahale · Jikai Jin · Pratik Kumar Jawanpuria · Gaurav Kumar Yadav · Kazuki Koyama · Junyoung Kim · Xiao Li · Saugata Purkayastha · Adil Salim · Dighanchal Banerjee · Peter Richtarik · Lakshman Mahto · Tian Ye · Bamdev Mishra · Huikang Liu · Jiajie Zhu -
2020 Poster: Statistical Optimal Transport posed as Learning Kernel Embedding »
Saketha Nath Jagarlapudi · Pratik Kumar Jawanpuria -
2018 Poster: Inexact trust-region algorithms on Riemannian manifolds »
Hiroyuki Kasai · Bamdev Mishra -
2018 Poster: A Dual Framework for Low-rank Tensor Completion »
Madhav Nimishakavi · Pratik Kumar Jawanpuria · Bamdev Mishra -
2015 Poster: Efficient Output Kernel Learning for Multiple Tasks »
Pratik Kumar Jawanpuria · Maksim Lapin · Matthias Hein · Bernt Schiele