Timezone: »

Deep Learning through Information Geometry
Pratik Chaudhari · Alexander Alemi · Varun Jog · Dhagash Mehta · Frank Nielsen · Stefano Soatto · Greg Ver Steeg

Sat Dec 12 09:20 AM -- 06:30 PM (PST) @ None
Event URL: https://sites.google.com/view/dl-info-neurips20 »

Attempts at understanding deep learning have come from different disciplines, namely physics, statistics, information theory, and machine learning. These lines of investigation have very different modeling assumptions and techniques; it is unclear how their results may be reconciled together. This workshop builds upon the observation that Information Geometry has strong overlaps with these directions and may serve as a means to develop a holistic understanding of deep learning. The workshop program is designed to answer two specific questions. The first question is: how do geometry of the hypothesis class and information-theoretic properties of optimization inform generalization. Good datasets have been a key propeller of the empirical success of deep networks. Our theoretical understanding of data is however poor. The second question the workshop will focus on is: how can we model data and use the understanding of data to improve optimization/generalization in the low-data regime.

Gather.Town link: https://neurips.gather.town/app/vPYEDmTHeUbkACgf/dl-info-neurips2020

Sat 9:20 a.m. - 9:30 a.m.
Opening Remarks
Sat 9:30 a.m. - 10:15 a.m.
Keynote 1: Ke Sun (Keynote) Video
Ke Sun
Sat 10:15 a.m. - 10:30 a.m.

Prasad Cheema, Mahito Sugiyama

Prasad Cheema, Mahito Sugiyama
Sat 10:30 a.m. - 10:45 a.m.

Tian Han, Jun Zhang, Ying Nian Wu

Tian Han
Sat 10:45 a.m. - 11:30 a.m.
Keynote 2: Marco Gori (Keynote) Video
Marco Gori
Sat 12:30 p.m. - 1:15 p.m.
Keynote 3: Shun-ichi Amari (Keynote) Video
Shun-ichi Amari
Sat 1:15 p.m. - 2:00 p.m.
Keynote 4: Alexander Rakhlin (Keynote)
Alexander Rakhlin
Sat 2:15 p.m. - 2:30 p.m.

Yansong Gao, Pratik Chaudhari

Yansong Gao
Sat 2:30 p.m. - 3:15 p.m.
Keynote 5: Gintare Karolina Dziugaite (Keynote) Video
Gintare Karolina Dziugaite
Sat 3:15 p.m. - 4:00 p.m.
Keynote 6: Guido Montufar (Keynote)
Guido Montufar
Sat 4:00 p.m. - 4:15 p.m.

Rob Brekelmans, Vaden Masrani, Thang D Bui, Frank Wood, Aram Galstyan, Greg Ver Steeg, Frank Nielsen

Rob Brekelmans
Sat 4:30 p.m. - 5:00 p.m.
Panel Discussion and Closing Remarks
Sat 5:00 p.m. - 6:30 p.m.
Poster Session (Gather Town) (Poster Session)

Author Information

Pratik Chaudhari (University of Pennsylvania)
Alex Alemi (Google)
Varun Jog (University of Wisconsin-Madison)
Dhagash Mehta (The Vanguard Group)
Frank Nielsen (Sony CS Labs Inc.)
Stefano Soatto (UCLA)
Greg Ver Steeg (USC Information Sciences Institute)

More from the Same Authors