Search All 2022 Events
 

30 Results

<<   <   Page 1 of 3   >   >>
Poster
Tue 9:00 Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Loss
Jason Altschuler · Kunal Talwar
Poster
Thu 9:00 Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion
Jialun Zhang · Hong-Ming Chiu · Richard Y Zhang
Poster
Tue 14:00 Is Integer Arithmetic Enough for Deep Learning Training?
Alireza Ghaffari · Marzieh S. Tahaei · Mohammadreza Tayaranian · Masoud Asgharian · Vahid Partovi Nia
Poster
Wed 9:00 Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays
Konstantin Mishchenko · Francis Bach · Mathieu Even · Blake Woodworth
Poster
Thu 9:00 Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams
Sergey Denisov · H. Brendan McMahan · John Rush · Adam Smith · Abhradeep Guha Thakurta
Poster
Thu 9:00 Better SGD using Second-order Momentum
Hoang Tran · Ashok Cutkosky
Poster
Tue 9:00 Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution
Antonio Orvieto · Simon Lacoste-Julien · Nicolas Loizou
Poster
Thu 14:00 Variance Reduced ProxSkip: Algorithm, Theory and Application to Federated Learning
Grigory Malinovsky · Kai Yi · Peter Richtarik
Poster
Tue 9:00 Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees
Jue WANG · Binhang Yuan · Luka Rimanic · Yongjun He · Tri Dao · Beidi Chen · Christopher Ré · Ce Zhang
Poster
Escaping Saddle Points with Bias-Variance Reduced Local Perturbed SGD for Communication Efficient Nonconvex Distributed Learning
Tomoya Murata · Taiji Suzuki
Poster
Thu 14:00 Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning
Anastasiia Koloskova · Sebastian Stich · Martin Jaggi
Poster
Thu 9:00 Chaotic Dynamics are Intrinsic to Neural Network Training with SGD
Luis Herrmann · Maximilian Granz · Tim Landgraf