Timezone: »

 
Poster
On the Convergence and Robustness of Training GANs with Regularized Optimal Transport
Maziar Sanjabi · Jimmy Ba · Meisam Razaviyayn · Jason Lee

Tue Dec 04 07:45 AM -- 09:45 AM (PST) @ Room 210 #20
in Tue Poster Session A »

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions. Unfortunately, minimizing the Wasserstein distance between the data distribution and the generative model distribution is a computationally challenging problem as its objective is non-convex, non-smooth, and even hard to compute. In this work, we show that obtaining gradient information of the smoothed Wasserstein GAN formulation, which is based on regularized Optimal Transport (OT), is computationally effortless and hence one can apply first order optimization methods to minimize this objective. Consequently, we establish theoretical convergence guarantee to stationarity for a proposed class of GAN optimization algorithms. Unlike the original non-smooth formulation, our algorithm only requires solving the discriminator to approximate optimality. We apply our method to learning MNIST digits as well as CIFAR-10 images. Our experiments show that our method is computationally efficient and generates images comparable to the state of the art algorithms given the same architecture and computational power.

Keywords: Adversarial Networks · Generative Models · Non-Convex Optimization
[ Paper] 

Author Information

Maziar Sanjabi (University of Southern California)
Jimmy Ba
Meisam Razaviyayn (University of Southern California)
Jason Lee (University of Southern California)

More from the Same Authors