Skip to yearly menu bar Skip to main content


Poster

Faster Stochastic Algorithms for Minimax Optimization under Polyak-{\L}ojasiewicz Condition

Lesi Chen · Boyuan Yao · Luo Luo

Keywords: [ Stochastic minimax optimization ] [ Polyak-Lojasiewicz condition ]


Abstract: This paper considers stochastic first-order algorithms for minimax optimization under Polyak-{\L}ojasiewicz (PL) conditions. We propose SPIDER-GDA for solving the finite-sum problem of the form minxmaxyf(x,y)1nni=1fi(x,y), where the objective function f(x,y) is μx-PL in x and μy-PL in y; and each fi(x,y) is L-smooth. We prove SPIDER-GDA could find an ϵ-approximate solution within O((n+nκxκ2y)log(1/ϵ)) stochastic first-order oracle (SFO) complexity, which is better than the state-of-the-art method whose SFO upper bound is O((n+n2/3κxκ2y)log(1/ϵ)), where κxL/μx and κyL/μy.For the ill-conditioned case, we provide an accelerated algorithm to reduce the computational cost further. It achieves ˜O((n+nκxκy)log2(1/ϵ)) SFO upper bound when κxn. Our ideas also can be applied to the more general setting that the objective function only satisfies PL condition for one variable. Numerical experiments validate the superiority of proposed methods.

Chat is not available.