Poster
in
Workshop: Federated Learning: Recent Advances and New Challenges
Stochastic Gradient Methods with Compressed Communication for Decentralized Saddle Point Problems
Chhavi Sharma · Vishnu Narayanan · Balamurugan Palaniappan
Abstract:
We develop two compression based stochastic gradient algorithms to solve a class of non-smooth strongly convex-strongly concave saddle-point problems in a decentralized setting (without a central server). Our first algorithm is a Restart-based Decentralized Proximal Stochastic Gradient method with Compression (C-RDPSG) for general stochastic settings. We provide rigorous theoretical guarantees of C-RDPSG with gradient computation complexity and communication complexity of order , to achieve an -accurate saddle-point solution, where denotes the compression factor, and denote respectively the condition numbers of objective function and communication graph, and denotes the smoothness parameter of the smooth part of the objective function. Next, we present a Decentralized Proximal Stochastic Variance Reduced Gradient algorithm with Compression (C-DPSVRG) for finite sum setting which exhibits gradient computation complexity and communication complexity of order . Extensive numerical experiments show competitive performance of the proposed algorithms and provide support to the theoretical results obtained.
Chat is not available.