Timezone: »
This paper addresses the problem of Unbalanced Optimal Transport (UOT) in which the marginal conditions are relaxed (using weighted penalties in lieu of equality) and no additional regularization is enforced on the OT plan. In this context, we show that the corresponding optimization problem can be reformulated as a non-negative penalized linear regression problem. This reformulation allows us to propose novel algorithms inspired from inverse problems and nonnegative matrix factorization. In particular, we consider majorization-minimization which leads in our setting to efficient multiplicative updates for a variety of penalties. Furthermore, we derive for the first time an efficient algorithm to compute the regularization path of UOT with quadratic penalties. The proposed algorithm provides a continuity of piece-wise linear OT plans converging to the solution of balanced OT (corresponding to infinite penalty weights). We perform several numerical experiments on simulated and real data illustrating the new algorithms, and provide a detailed discussion about more sophisticated optimization tools that can further be used to solve OT problems thanks to our reformulation.
Author Information
Laetitia Chapel (IRISA)
Rémi Flamary (École Polytechnique)
Haoran Wu (INSA Rennes)
Cédric Févotte (CNRS, University of Toulouse)
Cédric Févotte is a CNRS research director with the Institut de Recherche en Informatique de Toulouse (IRIT). Previously, he has been a CNRS researcher at Laboratoire Lagrange (Nice, 2013-2016) & Télécom ParisTech (2007-2013), a research engineer at Mist-Technologies (the startup that became Audionamix, 2006-2007) and a postdoc at University of Cambridge (2003-2006). He holds MEng and PhD degrees in EECS from École Centrale de Nantes. His research interests concern statistical signal processing and machine learning, with particular interests in matrix factorisation, representation learning, source separation and recommender systems. He is currently the principal investigator of the European Research Council (ERC) project FACTORY (New paradigms for latent factor estimation, 2016-2022, 2M€).
Gilles Gasso (LITIS - INSA Rouen Normandie)
More from the Same Authors
-
2021 : Factored couplings in multi-marginal optimal transport via difference of convex programming »
Quang Huy TRAN · Hicham Janati · Ievgen Redko · Rémi Flamary · Nicolas Courty -
2021 : Factored couplings in multi-marginal optimal transport via difference of convex programming »
Quang Huy TRAN · Hicham Janati · Ievgen Redko · Rémi Flamary · Nicolas Courty -
2022 Poster: Aligning individual brains with fused unbalanced Gromov Wasserstein »
Alexis Thual · Quang Huy TRAN · Tatiana Zemskova · Nicolas Courty · Rémi Flamary · Stanislas Dehaene · Bertrand Thirion -
2022 Poster: Template based Graph Neural Network with Optimal Transport Distances »
Cédric Vincent-Cuaz · Rémi Flamary · Marco Corneli · Titouan Vayer · Nicolas Courty -
2021 Workshop: Optimal Transport and Machine Learning »
Jason Altschuler · Charlotte Bunne · Laetitia Chapel · Marco Cuturi · Rémi Flamary · Gabriel Peyré · Alexandra Suvorikova -
2020 Poster: CO-Optimal Transport »
Titouan Vayer · Ievgen Redko · Rémi Flamary · Nicolas Courty -
2020 Poster: Partial Optimal Transport with applications on Positive-Unlabeled Learning »
Laetitia Chapel · Mokhtar Z. Alaya · Gilles Gasso -
2019 Workshop: Optimal Transport for Machine Learning »
Marco Cuturi · Gabriel Peyré · Rémi Flamary · Alexandra Suvorikova -
2019 Poster: Screening Sinkhorn Algorithm for Regularized Optimal Transport »
Mokhtar Z. Alaya · Maxime Berar · Gilles Gasso · Alain Rakotomamonjy -
2019 Poster: Sliced Gromov-Wasserstein »
Titouan Vayer · Rémi Flamary · Nicolas Courty · Romain Tavenard · Laetitia Chapel -
2017 : Domain adaptation with optimal transport : from mapping to learning with joint distribution »
Rémi Flamary -
2017 : 6 x 3 minutes spotlights »
Rémi Flamary · Yongxin Chen · Napat Rujeerapaiboon · Jonas Adler · John Lee · Lucas R Roberts -
2017 Poster: Joint distribution optimal transportation for domain adaptation »
Nicolas Courty · Rémi Flamary · Amaury Habrard · Alain Rakotomamonjy -
2016 Poster: Optimal spectral transportation with application to music transcription »
Rémi Flamary · Cédric Févotte · Nicolas Courty · Valentin Emiya -
2016 Poster: Mapping Estimation for Discrete Optimal Transport »
Michaël Perrot · Nicolas Courty · Rémi Flamary · Amaury Habrard -
2014 Poster: Low-Rank Time-Frequency Synthesis »
Cédric Févotte · Matthieu Kowalski -
2011 Poster: Nonnegative dictionary learning in the exponential noise model for adaptive music signal representation »
Onur Dikmen · Cédric Févotte -
2007 Workshop: Topology Learning: New Challenges At the Crossing of Machine Learning, »
Michael Aupetit · Frederic Chazal · Gilles Gasso · David Cohen-Steiner · pierre gaillard