Workshop: Beyond BackPropagation: Novel Ideas for Training Neural Architectures
Mateusz Malinowski, Grzegorz Swirszcz, Viorica Patraucean, Marco Gori, Yanping Huang, Sindy Löwe, Anna Choromanska
Sat, Dec 12th @ 14:00 GMT – Sun, Dec 13th @ 00:30 GMT
Abstract: Is backpropagation the ultimate tool on the path to achieving synthetic intelligence as its success and widespread adoption would suggest?
Many have questioned the biological plausibility of backpropagation as a learning mechanism since its discovery. The weight transport and timing problems are the most disputable. The same properties of backpropagation training also have practical consequences. For instance, backpropagation training is a global and coupled procedure that limits the amount of possible parallelism and yields high latency.
These limitations have motivated us to discuss possible alternative directions. In this workshop, we want to promote such discussions by bringing together researchers from various but related disciplines, and to discuss possible solutions from engineering, machine learning and neuroscientific perspectives.
Many have questioned the biological plausibility of backpropagation as a learning mechanism since its discovery. The weight transport and timing problems are the most disputable. The same properties of backpropagation training also have practical consequences. For instance, backpropagation training is a global and coupled procedure that limits the amount of possible parallelism and yields high latency.
These limitations have motivated us to discuss possible alternative directions. In this workshop, we want to promote such discussions by bringing together researchers from various but related disciplines, and to discuss possible solutions from engineering, machine learning and neuroscientific perspectives.
Chat
To ask questions please use rocketchat, available only upon registration and login.
Schedule
14:00 – 14:15 GMT
Live Intro
Mateusz Malinowski, Viorica Patraucean, Grzegorz Swirszcz, Sindy Löwe, Anna Choromanska, Marco Gori, Yanping Huang
14:15 – 14:17 GMT
Introduction: Bastiaan Veeling
Mateusz Malinowski
14:17 – 14:45 GMT
Invited Talk Bastiaan Veeling
Bas Veeling
14:45 – 14:47 GMT
Introduction: Olivier Teytaud
Sindy Löwe
14:47 – 15:15 GMT
Invited Talk Olivier Teytaud
Olivier Teytaud
15:15 – 16:30 GMT
Poster Session: Morning
16:30 – 16:32 GMT
Introduction: Karl Friston
Mateusz Malinowski
16:32 – 17:00 GMT
Invited Talk Karl Friston
Karl Friston
17:00 – 17:45 GMT
Panel discussion 1
Bas Veeling, Olivier Teytaud, Karl Friston, Sindy Löwe, Mateusz Malinowski
17:45 – 19:00 GMT
Long Break
19:00 – 19:02 GMT
Introduction: Yoshua Bengio
Anna Choromanska
19:02 – 19:32 GMT
Invited Talk Yoshua Bengio
Yoshua Bengio
19:32 – 19:34 GMT
Introduction: Danielle Bassett
Anna Choromanska
19:34 – 20:08 GMT
Invited Talk Danielle Bassett
Dani S Bassett
20:09 – 20:10 GMT
Introduction: Oral 1.1 and Oral 1.2
Viorica Patraucean
20:10 – 20:22 GMT
Orals 1.1: Randomized Automatic Differentiation
Deniz Oktay, Nick B McGreivy, Alex Beatson, Ryan Adams
20:22 – 20:35 GMT
Orals 1.2: ZORB: A Derivative-Free Backpropagation Algorithm for Neural Networks
Varun Ranganathan, Alex Lewandowski
20:35 – 20:40 GMT
Oral 1.1 and 1.2 Q&A
20:40 – 20:45 GMT
Short Break 2
20:45 – 20:46 GMT
Introduction: Oral 2.1 and Oral 2.2
Viorica Patraucean
20:46 – 20:59 GMT
Orals 2.1: Policy Manifold Search for Improving Diversity-based Neuroevolution
Nemanja Rakicevic
20:59 – 21:12 GMT
Orals 2.2: Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignmen
Julien Launay, Iacopo Poli, Laurent Daudet, Florent Krzakala
21:12 – 21:15 GMT
Oral 2.1 and Oral 2.2 Q&A
21:15 – 21:17 GMT
Introduction: David Duvenaud
Yanping Huang
21:17 – 21:45 GMT
Invited Talk David Duvenaud
David Duvenaud
21:45 – 21:47 GMT
Introduction: Cristina Savin
Yanping Huang
21:47 – 22:15 GMT
Invited Talk Cristina Savin
Cristina Savin
22:15 – 23:00 GMT
Panel discussion 2
Dani S Bassett, Yoshua Bengio, Cristina Savin, David Duvenaud, Anna Choromanska, Yanping Huang
Sat, Dec 12th @ 23:00 GMT – Sun, Dec 13th @ 00:30 GMT