Timezone: »
Generative Adversarial Networks (GANs) are powerful models for learning complex distributions. Stable training of GANs has been addressed in many recent works which explore different metrics between distributions. In this paper we introduce Fisher GAN that fits within the Integral Probability Metrics (IPM) framework for training GANs. Fisher GAN defines a data dependent constraint on the second order moments of the critic. We show in this paper that Fisher GAN allows for stable and time efficient training that does not compromise the capacity of the critic, and does not need data independent constraints such as weight clipping. We analyze our Fisher IPM theoretically and provide an algorithm based on Augmented Lagrangian for Fisher GAN. We validate our claims on both image sample generation and semi-supervised classification using Fisher GAN.
Author Information
Youssef Mroueh (IBM T.J Watson Research Center)
Tom Sercu (IBM Research)
More from the Same Authors
-
2021 Spotlight: Measuring Generalization with Optimal Transport »
Ching-Yao Chuang · Youssef Mroueh · Kristjan Greenewald · Antonio Torralba · Stefanie Jegelka -
2021 : Optimizing Functionals on the Space of Probabilities with Input Convex Neural Network »
David Alvarez-Melis · Yair Schiff · Youssef Mroueh -
2021 : Optimizing Functionals on the Space of Probabilities with Input Convex Neural Network »
David Alvarez-Melis · Yair Schiff · Youssef Mroueh -
2021 Poster: Language models enable zero-shot prediction of the effects of mutations on protein function »
Joshua Meier · Roshan Rao · Robert Verkuil · Jason Liu · Tom Sercu · Alex Rives -
2021 Poster: Measuring Generalization with Optimal Transport »
Ching-Yao Chuang · Youssef Mroueh · Kristjan Greenewald · Antonio Torralba · Stefanie Jegelka -
2021 Poster: Separation Results between Fixed-Kernel and Feature-Learning Probability Metrics »
Carles Domingo i Enrich · Youssef Mroueh -
2021 Oral: Separation Results between Fixed-Kernel and Feature-Learning Probability Metrics »
Carles Domingo i Enrich · Youssef Mroueh -
2020 Poster: Unbalanced Sobolev Descent »
Youssef Mroueh · Mattia Rigotti -
2020 Poster: A Decentralized Parallel Algorithm for Training Generative Adversarial Nets »
Mingrui Liu · Wei Zhang · Youssef Mroueh · Xiaodong Cui · Jarret Ross · Tianbao Yang · Payel Das -
2019 Poster: Sobolev Independence Criterion »
Youssef Mroueh · Tom Sercu · Mattia Rigotti · Inkit Padhi · Cicero Nogueira dos Santos