Timezone: »

 
Workshop
Perception as generative reasoning: structure, causality, probability
Dan Rosenbaum · Marta Garnelo · Peter Battaglia · Kelsey Allen · Ilker Yildirim

Fri Dec 13 08:00 AM -- 06:00 PM (PST) @ East Meeting Rooms 1 - 3
Event URL: https://pgr-workshop.github.io »

Many perception tasks can be cast as ‘inverse problems’ where the input signal is the outcome of a causal process and perception is to invert that process. For example in visual object perception, the image is caused by an object and perception is to infer which object gave rise to that image. Following an analysis-by-synthesis approach, modelling the forward and causal direction of the data generation process is a natural way to capture the underlying scene structure, which typically leads to broader generalisation and better sample efficiency. Such a forward model can be applied to solve the inverse problem (inferring the scene structure from an input image) using Bayes rule, for example. This workflow stands in contrast to common approaches in deep learning, where typically one first defines a task, and then optimises a deep model end-to-end to solve it. In this workshop we propose to revisit ideas from the generative approach and advocate for learning-based analysis-by-synthesis methods for perception and inference. In addition, we pose the question of how ideas from these research areas can be combined with and complement modern deep learning practices.

Fri 8:50 a.m. - 9:00 a.m. [iCal]
Opening Remarks (Talk)
Dan Rosenbaum, Marta Garnelo, Peter Battaglia, Kelsey Allen, Ilker Yildirim
Fri 9:00 a.m. - 9:35 a.m. [iCal]
Tatiana Lopez-Guevara (Talk)
Tatiana López-Guevara
Fri 9:35 a.m. - 9:50 a.m. [iCal]
Spotlights 1 (Spotlight)
Michael Chang, Jan Chorowski, Matthew Dirks
Fri 10:30 a.m. - 11:05 a.m. [iCal]
Josh Tenenbaum (Talk)
Josh Tenenbaum
Fri 11:05 a.m. - 11:40 a.m. [iCal]
Sanja Fidler (Talk)
Sanja Fidler
Fri 11:40 a.m. - 12:00 p.m. [iCal]
Spotlights 2 (Spotlight)
Boyang Deng, Eric Crawford
Fri 1:30 p.m. - 2:05 p.m. [iCal]
Niloy Mitra (Talk)
Niloy Mitra
Fri 2:05 p.m. - 2:40 p.m. [iCal]
Danilo Rezende (Talk)
Danilo Jimenez Rezende
Fri 2:40 p.m. - 3:30 p.m. [iCal]
Posters (Poster Session)
Colin Graber, Yuan-Ting Hu, Tiantian Fang, Jessica Hamrick, Giorgio Giannone, JD Co-Reyes, Boyang Deng, Eric Crawford, Andrea Dittadi, Peter Karkus, Matthew Dirks, Rakshit Trivedi, Sunny Raj, Javier Felip Leon, Harris Chan, Jan Chorowski, Jeff Orchard, Aleksandar Stanić, Adam Kortylewski, Ben Zinberg, Chenghui Zhou, Wei Sun, Vikash Mansinghka, Chun-Liang Li, Marco Cusumano-Towner
Fri 4:15 p.m. - 5:15 p.m. [iCal]
Panel (Panel Discussion)
Sanja Fidler, Josh Tenenbaum, Tatiana López-Guevara, Danilo Jimenez Rezende, Niloy Mitra
Fri 5:15 p.m. - 5:30 p.m. [iCal]
Closing remarks (Talk)
Dan Rosenbaum, Marta Garnelo, Peter Battaglia, Kelsey Allen, Ilker Yildirim

Author Information

Dan Rosenbaum (DeepMind)
Marta Garnelo (DeepMind)
Peter Battaglia (DeepMind)
Kelsey Allen (MIT)
Ilker Yildirim (Yale University)

More from the Same Authors