Workshop
Deep Learning through Information Geometry
Pratik Chaudhari · Alexander Alemi · Varun Jog · Dhagash Mehta · Frank Nielsen · Stefano Soatto · Greg Ver Steeg
Attempts at understanding deep learning have come from different disciplines, namely physics, statistics, information theory, and machine learning. These lines of investigation have very different modeling assumptions and techniques; it is unclear how their results may be reconciled together. This workshop builds upon the observation that Information Geometry has strong overlaps with these directions and may serve as a means to develop a holistic understanding of deep learning. The workshop program is designed to answer two specific questions. The first question is: how do geometry of the hypothesis class and information-theoretic properties of optimization inform generalization. Good datasets have been a key propeller of the empirical success of deep networks. Our theoretical understanding of data is however poor. The second question the workshop will focus on is: how can we model data and use the understanding of data to improve optimization/generalization in the low-data regime.
Gather.Town link: [ protected link dropped ]
Schedule
Sat 9:20 a.m. - 9:30 a.m.
|
Opening Remarks
(
Opening Remarks
)
>
|
🔗 |
Sat 9:30 a.m. - 10:15 a.m.
|
Keynote 1: Ke Sun
(
Keynote
)
>
SlidesLive Video |
Ke SUN 🔗 |
Sat 10:15 a.m. - 10:30 a.m.
|
Contributed Talk 1: The Volume of Non-Restricted Boltzmann Machines and Their Double Descent Model Complexity
(
Contributed Talk
)
>
SlidesLive Video Prasad Cheema, Mahito Sugiyama |
Prasad Cheema · Mahito Sugiyama 🔗 |
Sat 10:30 a.m. - 10:45 a.m.
|
Contributed Talk 2: From em-Projections to Variational Auto-Encoder
(
Contributed Talk
)
>
SlidesLive Video Tian Han, Jun Zhang, Ying Nian Wu |
Tian Han 🔗 |
Sat 10:45 a.m. - 11:30 a.m.
|
Keynote 2: Marco Gori
(
Keynote
)
>
SlidesLive Video |
Marco Gori 🔗 |
Sat 12:30 p.m. - 1:15 p.m.
|
Keynote 3: Shun-ichi Amari
(
Keynote
)
>
SlidesLive Video |
Shun-ichi Amari 🔗 |
Sat 1:15 p.m. - 2:00 p.m.
|
Keynote 4: Alexander Rakhlin
(
Keynote
)
>
|
Alexander Rakhlin 🔗 |
Sat 2:15 p.m. - 2:30 p.m.
|
Contributed Talk 3: An Information-Geometric Distance on the Space of Tasks
(
Contributed Talk
)
>
SlidesLive Video Yansong Gao, Pratik Chaudhari |
Yansong Gao 🔗 |
Sat 2:30 p.m. - 3:15 p.m.
|
Keynote 5: Gintare Karolina Dziugaite
(
Keynote
)
>
SlidesLive Video |
Gintare Karolina Dziugaite 🔗 |
Sat 3:15 p.m. - 4:00 p.m.
|
Keynote 6: Guido Montufar
(
Keynote
)
>
|
Guido Montufar 🔗 |
Sat 4:00 p.m. - 4:15 p.m.
|
Contributed Talk 4: Annealed Importance Sampling with q-Paths
(
Contributed Talk
)
>
SlidesLive Video Rob Brekelmans, Vaden Masrani, Thang D Bui, Frank Wood, Aram Galstyan, Greg Ver Steeg, Frank Nielsen |
Rob Brekelmans 🔗 |
Sat 4:30 p.m. - 5:00 p.m.
|
Panel Discussion and Closing Remarks
(
Panel Discussion and Closing Remarks
)
>
|
🔗 |
Sat 5:00 p.m. - 6:30 p.m.
|
Poster Session (Gather Town) ( Poster Session ) > link | 🔗 |