Skip to yearly menu bar Skip to main content


(42 events)   Timezone:  
Show all
Toggle Poster Visibility
Fri Dec 02 06:15 AM -- 06:30 AM (PST) None
Welcome and Opening Remarks
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 06:30 AM -- 07:15 AM (PST) None
Efficient Second-Order Stochastic Methods for Machine Learning
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Donald Goldfarb
Fri Dec 02 07:15 AM -- 08:00 AM (PST) None
Tensor Methods for Nonconvex Optimization.
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Coralia Cartis
Fri Dec 02 08:00 AM -- 08:30 AM (PST) None
Coffee Break
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 08:00 AM -- 08:30 AM (PST) None
Poster Session I
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 08:30 AM -- 08:45 AM (PST) None
Quartic Polynomial Sub-problem Solutions in Tensor Methods for Nonconvex Optimization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Wenqi Zhu
Fri Dec 02 08:45 AM -- 09:00 AM (PST) None
PSPS: Preconditioned Stochastic Polyak Step-size method for badly scaled data
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Farshed Abdukhakimov
Fri Dec 02 09:00 AM -- 09:15 AM (PST) None
DRSOM: A Dimension Reduced Second-Order Method
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Chuwen Zhang
Fri Dec 02 09:15 AM -- 09:30 AM (PST) None
Disentangling the Mechanisms Behind Implicit Regularization in SGD
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Zachary Novack
Fri Dec 02 09:30 AM -- 09:45 AM (PST) None
Cubic Regularized Quasi-Newton Methods
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Klea Ziu
Fri Dec 02 09:45 AM -- 10:00 AM (PST) None
Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Kabir Chandrasekher
Fri Dec 02 10:00 AM -- 11:30 AM (PST) None
Lunch Break
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 11:30 AM -- 12:15 PM (PST) None
Deterministically Constrained Stochastic Optimization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Frank E. Curtis
Fri Dec 02 12:15 PM -- 01:00 PM (PST) None
Low Rank Approximation for Faster Convex Optimization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Madeleine Udell
Fri Dec 02 01:00 PM -- 01:30 PM (PST) None
Coffee Break
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 01:00 PM -- 02:00 PM (PST) None
Poster Session II
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Fri Dec 02 02:00 PM -- 02:45 PM (PST) None
A Fast, Fisher Based Pruning of Transformers without Retraining
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Amir Gholami
Fri Dec 02 02:45 PM -- 03:00 PM (PST) None
Closing Remarks
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
None
FLECS-CGD: A Federated Learning Second-Order Framework via Compression and Sketching with Compressed Gradient Differences
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Artem Agafonov · Brahim Erraji · Martin Takac
None
Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Qiujiang Jin · Aryan Mokhtari · Nhat Ho · Tongzheng Ren
[ Poster] 
None
The Trade-offs of Incremental Linearization Algorithms for Nonsmooth Composite Problems
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Krishna Pillutla · Vincent Roulet · Sham Kakade · Zaid Harchaoui
[ Poster] 
None
Cubic Regularized Quasi-Newton Methods
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Dmitry Kamzolov · Klea Ziu · Artem Agafonov · Martin Takac
[ Poster] 
None
ASDL: A Unified Interface for Gradient Preconditioning in PyTorch
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Kazuki Osawa · Satoki Ishikawa · Rio Yokota · Shigang Li · Torsten Hoefler
[ Poster] 
None
PSPS: Preconditioned Stochastic Polyak Step-size method for badly scaled data
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Farshed Abdukhakimov · Chulu Xiang · Dmitry Kamzolov · Robert Gower · Martin Takac
[ Poster] 
None
HesScale: Scalable Computation of Hessian Diagonals
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Mohamed Elsayed · Rupam Mahmood
[ Poster] 
None
High-Order Optimization of Gradient Boosted Decision Trees
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Jean Pachebat · Sergey IVANOV
[ Poster] 
None
Disentangling the Mechanisms Behind Implicit Regularization in SGD
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Zachary Novack · Simran Kaur · Tanya Marwah · Saurabh Garg · Zachary Lipton
[ Poster] 
None
How Small Amount of Data Sharing Benefits Higher-Order Distributed Optimization and Learning
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Mingxi Zhu · Yinyu Ye
[ Poster] 
None
A Stochastic Conjugate Subgradient Algorithm for Kernelized Support Vector Machines: The Evidence
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Di Zhang · Suvrajeet Sen
[ Poster] 
None
Perseus: A Simple and Optimal High-Order Method for Variational Inequalities
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Tianyi Lin · Michael Jordan
[ Poster] 
None
Random-subspace adaptive cubic regularisation method for nonconvex optimisation
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Coralia Cartis · Zhen Shao
[ Poster] 
None
DRSOM: A Dimension Reduced Second-Order Method
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Chuwen Zhang · Jiang Bo · Chang He · Yuntian Jiang · Dongdong Ge · Yinyu Ye
None
Black Box Lie Group Preconditioners for SGD
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Xilin Li
[ Poster] 
None
Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models: First-Order Stationarity
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Yuchen Fang · Sen Na · Mladen Kolar
[ Poster] 
None
Using quadratic equations for overparametrized models
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Shuang Li · William Swartworth · Martin Takac · Deanna Needell · Robert Gower
None
On the Global Convergence of the Regularized Generalized Gauss-Newton Algorithm
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Vincent Roulet · Maryam Fazel · Siddhartha Srinivasa · Zaid Harchaoui
[ Poster] 
None
Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Yuchen Fang · Sen Na · Mladen Kolar
[ Poster] 
None
Effects of momentum scaling for SGD
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Dmitry A. Pasechnyuk · Alexander Gasnikov · Martin Takac
[ Poster] 
None
Distributed Newton-Type Methods with Communication Compression and Bernoulli Aggregation
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Rustem Islamov · Xun Qian · Slavomír Hanzely · Mher Safaryan · Peter Richtarik
[ Poster] 
None
Improving Levenberg-Marquardt Algorithm for Neural Networks
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Omead Pooladzandi · Yiming Zhou
[ Poster] 
None
Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
MENGQI LOU · Kabir Chandrasekher · Ashwin Pananjady
[ Poster] 
None
Quartic Polynomial Sub-problem Solutions in Tensor Methods for Nonconvex Optimization
In Order up! The Benefits of Higher-Order Optimization in Machine Learning
Wenqi Zhu · Coralia Cartis
[ Poster]