|
Affinity Event
|
|
Enhancing Communication Efficiency and Robustness in Split-Federated Learning with Rate-Distortion inspired Compression
Chamani Shiranthika Jayakody Kankanamalage · Hadi Hadizadeh · Ivan Bajić · Parvaneh Saeedi
|
|
|
Workshop
|
Sun 11:14
|
Muxing Wang, Pengkun Yang & Lili Su. On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
|
|
|
Workshop
|
|
On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
Muxing Wang · Pengkun Yang · Lili Su
|
|
|
Workshop
|
|
A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
Kairong Luo · Haodong Wen · Shengding Hu · Zhenbo Sun · Zhiyuan Liu · Maosong Sun · Kaifeng Lyu · Wenguang Chen
|
|
|
Workshop
|
|
Different Rates for Different Weights: Decoupled Relative Learning Rate Schedules
Jan Ludziejewski · Jan Małaśnicki · Maciej Pióro · Michał Krutul · Kamil Ciebiera · Jakub Krajewski · Marek Cygan · Kamil Adamczewski · Sebastian Jaszczur
|
|
|
Poster
|
Thu 11:00
|
Universal Rates for Active Learning
Steve Hanneke · Amin Karbasi · Shay Moran · Grigoris Velegkas
|
|
|
Poster
|
Fri 16:30
|
Fast Rates in Stochastic Online Convex Optimization by Exploiting the Curvature of Feasible Sets
Taira Tsuchiya · Shinji Ito
|
|
|
Poster
|
Fri 11:00
|
An In-depth Investigation of Sparse Rate Reduction in Transformer-like Models
Yunzhe Hu · Difan Zou · Dong Xu
|
|
|
Poster
|
Fri 11:00
|
Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression
Deqing Fu · Tian-qi Chen · Robin Jia · Vatsal Sharan
|
|
|
Poster
|
Thu 16:30
|
Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training
Atli Kosson · Bettina Messmer · Martin Jaggi
|
|
|
Workshop
|
|
GaLore-mini: Low Rank Gradient Learning with Fewer Learning Rates
WH Huang · Zhenyu Zhang · Yushun Zhang · Zhiquan Luo · Ruoyu Sun · Zhangyang "Atlas" Wang
|
|
|
Poster
|
Thu 11:00
|
Small steps no more: Global convergence of stochastic gradient bandits for arbitrary learning rates
Jincheng Mei · Bo Dai · Alekh Agarwal · Sharan Vaswani · Anant Raj · Csaba Szepesvari · Dale Schuurmans
|
|
