|
Poster
|
Thu 8:45
|
A Computation and Communication Efficient Method for Distributed Nonconvex Problems in the Partial Participation Setting
Alexander Tyurin · Peter Richtarik
|
|
|
Poster
|
Tue 15:15
|
Optimal Time Complexities of Parallel Stochastic Optimization Methods Under a Fixed Computation Model
Alexander Tyurin · Peter Richtarik
|
|
|
Workshop
|
Sat 12:00
|
Crafting Computational Efficiency for Large Models: Training Recipes, Scaling Strategies and Sparsity Sorcery with Specialized Hardware
Natalia Vassilieva
|
|
|
Poster
|
Thu 8:45
|
Aggregating Capacity in FL through Successive Layer Training for Computationally-Constrained Devices
Kilian Pfeiffer · Ramin Khalili · Joerg Henkel
|
|
|
Poster
|
Wed 8:45
|
H3T: Efficient Integration of Memory Optimization and Parallelism for Large-scale Transformer Training
Yuzhong Wang · Xu Han · Weilin Zhao · Guoyang Zeng · Zhiyuan Liu · Maosong Sun
|
|
|
Poster
|
Thu 8:45
|
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies
Wei Fang · Zhaofei Yu · Zhaokun Zhou · Ding Chen · Yanqi Chen · Zhengyu Ma · Timothée Masquelier · Yonghong Tian
|
|
|
Poster
|
Thu 15:00
|
Epidemic Learning: Boosting Decentralized Learning with Randomized Communication
Martijn De Vos · Sadegh Farhadkhani · Rachid Guerraoui · Anne-marie Kermarrec · Rafael Pires · Rishi Sharma
|
|
|
Workshop
|
|
LightSeq: : Sequence Level Parallelism for Distributed Training of Long Context Transformers
Dacheng Li · Rulin Shao · Anze Xie · Eric Xing · Joseph Gonzalez · Ion Stoica · Xuezhe Ma · Hao Zhang
|
|
|
Workshop
|
|
Active learning for excited states dynamics simulations to discover molecular degradation pathways
Chen Zhou · Prashant Kumar · Daniel Escudero · Pascal Friederich
|
|
|
Poster
|
Wed 8:45
|
DropCompute: simple and more robust distributed synchronous training via compute variance reduction
Niv Giladi · Shahar Gottlieb · moran shkolnik · Asaf Karnieli · Ron Banner · Elad Hoffer · Kfir Y. Levy · Daniel Soudry
|
|
|
Poster
|
Wed 8:45
|
KAKURENBO: Adaptively Hiding Samples in Deep Neural Network Training
Truong Thao Nguyen · Balazs Gerofi · Edgar Josafat Martinez-Noriega · François Trahay · Mohamed Wahib
|
|
