Skip to yearly menu bar Skip to main content


Poster

Continuous-time Analysis of Anchor Acceleration

Jaewook Suh · Jisun Park · Ernest Ryu

Great Hall & Hall B1+B2 (level 1) #1114

Abstract: Recently, the anchor acceleration, an acceleration mechanism distinct from Nesterov's, has been discovered for minimax optimization and fixed-point problems, but its mechanism is not understood well, much less so than Nesterov acceleration. In this work, we analyze continuous-time models of anchor acceleration. We provide tight, unified analyses for characterizing the convergence rate as a function of the anchor coefficient β(t), thereby providing insight into the anchor acceleration mechanism and its accelerated O(1/k2)-convergence rate. Finally, we present an adaptive method inspired by the continuous-time analyses and establish its effectiveness through theoretical analyses and experiments.

Chat is not available.