Workshop
Heavy Tails in ML: Structure, Stability, Dynamics
Mert Gurbuzbalaban · Stefanie Jegelka · Michael Mahoney · Umut Simsekli
Room R02-R05 (level 2)
Fri 15 Dec, 7 a.m. PST
Heavy-tails and chaotic behavior naturally appear in many ways in ML. We aim to understand how they emerge and how they affect the properties of ML methods.
Chat is not available.
Timezone: America/Los_Angeles
Schedule
|
Fri 7:00 a.m. - 7:01 a.m.
|
Opening Remarks
(
Presentation
)
>
|
🔗 |
|
Fri 7:00 a.m. - 8:00 a.m.
|
Keynote: Adam Wierman
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 8:00 a.m. - 8:30 a.m.
|
Coffee break
|
🔗 |
|
Fri 8:30 a.m. - 9:10 a.m.
|
Invited talk: Liam Hodgkinson
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 9:10 a.m. - 9:35 a.m.
|
Contributed talk: Vivien Cabannes
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 9:35 a.m. - 10:00 a.m.
|
Contributed talk: Dominique Perrault-Joncas
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 10:00 a.m. - 12:00 p.m.
|
Lunch break
|
🔗 |
|
Fri 12:00 p.m. - 12:40 p.m.
|
Invited talk: Nisha Chandramoorthy
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 12:40 p.m. - 1:05 p.m.
|
Contributed talk: Jeremy Cohen
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 1:05 p.m. - 1:30 p.m.
|
Coffee break
|
🔗 |
|
Fri 1:30 p.m. - 2:10 p.m.
|
Invited talk: Charles Martin
(
Presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 2:10 p.m. - 3:30 p.m.
|
Poster session
(
Poster presentation
)
>
SlidesLive Video |
🔗 |
|
Fri 3:29 p.m. - 3:30 p.m.
|
Closing remarks
(
Presentation
)
>
|
🔗 |
|
-
|
Semi-Implicit Neural Ordinary Differential Equations for Learning Chaotic Systems ( Poster ) > link | Hong Zhang · Ying Liu · Romit Maulik 🔗 |
|
-
|
From Mutual Information to Expected Dynamics: New Generalization Bounds for Heavy-Tailed SGD ( Poster ) > link | Benjamin, Bernard, Louis DUPUIS · Paul Viallard 🔗 |
|
-
|
Instance-Aware Repeat Factor Sampling for Long-Tailed Object Detection ( Poster ) > link | Burhan Yaman · Tanvir Mahmud · Chun-Hao Liu 🔗 |
|
-
|
Meta-Analysis of Randomized Experiments with Applications to Heavy-Tailed Response Data ( Poster ) > link | Nilesh Tripuraneni · Dominique Perrault-Joncas · Dhruv Madeka · Dean Foster · Michael Jordan 🔗 |
|
-
|
The Effects of Ensembling on Long-Tailed Data ( Poster ) > link | Estefany Kelly Buchanan · Geoff Pleiss · John Cunningham 🔗 |
|
-
|
High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality ( Poster ) > link | Urte Adomaityte · Leonardo Defilippis · Bruno Loureiro · Gabriele Sicuro 🔗 |
|
-
|
Large Deviations and Metastability Analysis for Heavy-Tailed Dynamical Systems ( Poster ) > link | Chang-Han Rhee · Xingyu Wang 🔗 |
|
-
|
Associative Memories with Heavy-Tailed Data ( Poster ) > link | Vivien Cabannes · Elvis Dohmatob · Alberto Bietti 🔗 |
|
-
|
Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization ( Poster ) > link | Elan Rosenfeld · Andrej Risteski 🔗 |
|
-
|
Deep neural networks with dependent weights: \\Gaussian Process mixture limit, heavy tails, sparsity and compressibility ( Poster ) > link | Hoil Lee · Fadhel Ayed · Paul Jung · Juho Lee · Hongseok Yang · Francois Caron 🔗 |
|
-
|
Adaptive Gradient Methods at the Edge of Stability ( Poster ) > link | Jeremy M Cohen · Behrooz Ghorbani · Shankar Krishnan · Naman Agarwal · Sourabh Medapati · Michal Badura · Daniel Suo · Zachary Nado · George Dahl · Justin Gilmer 🔗 |
|
-
|
Online Student-$t$ Processes with an Overall-local Scale Structure for Modelling Non-stationary Data ( Poster ) > link | Taole Sha · Michael Minyi Zhang 🔗 |
|
-
|
On the Varied Faces of Overparameterization in Supervised and Self-Supervised Learning ( Poster ) > link | Matteo Gamba · Arna Ghosh · Kumar Krishna Agrawal · Blake Richards · Hossein Azizpour · Mårten Björkman 🔗 |
|
-
|
Neural network compression with heavy-tailed SGD ( Poster ) > link | Yijun Wan · Abdellatif Zaidi · Umut Simsekli 🔗 |
|
-
|
Representation Learning for Extremes ( Poster ) > link | Ali Hasan · Yuting Ng · Jose Blanchet · Vahid Tarokh 🔗 |
|
-
|
High Probability Guarantees for Random Reshuffling ( Poster ) > link | Hengxu Yu · Xiao Li 🔗 |
|
-
|
Towards Fully Adaptive Regret Minimization in Heavy-Tailed Bandits ( Poster ) > link | Gianmarco Genalti · Lupo Marsigli · Nicola Gatti · Alberto Maria Metelli 🔗 |
|
-
|
Robust gradient estimation in the presence of heavy-tailed noise ( Poster ) > link | Fabian Schaipp · Umut Simsekli · Robert Gower 🔗 |
|
-
|
Generalised Hyperbolic State-space Models for Inference in Dynamic Systems ( Poster ) > link | Yaman Kindap · Simon Godsill 🔗 |
|
-
|
Variational Inference for SDEs Driven by Fractional Noise ( Poster ) > link | Rembert Daems · Manfred Opper · Guillaume Crevecoeur · Tolga Birdal 🔗 |
|
-
|
Revisiting the noise Model of SGD ( Poster ) > link | Barak Battash · Ofir Lindenbaum 🔗 |