Timezone: »
Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large class of problems comprise underlying temporal dependency structures in a sequence of stochastic processes that Neural Processes (NP) do not explicitly consider. In this paper, we propose Sequential Neural Processes (SNP) which incorporates a temporal state-transition model of stochastic processes and thus extends its modeling capabilities to dynamic stochastic processes. In applying SNP to dynamic 3D scene modeling, we introduce the Temporal Generative Query Networks. To our knowledge, this is the first 4D model that can deal with the temporal dynamics of 3D scenes. In experiments, we evaluate the proposed methods in dynamic (non-stationary) regression and 4D scene inference and rendering.
Author Information
Gautam Singh (Rutgers University)
I am starting my second year as a Ph.D. student at the Department of Computer Science at Rutgers University. My focus area is probabilistic generative models. Prior to this, I worked at IBM Research India for 3 years after finishing my undergrad from IIT Guwahati.
Jaesik Yoon (SAP)
Youngsung Son (Electronics and Telecommunications Research Institute)
Sungjin Ahn (Rutgers University)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Spotlight: Sequential Neural Processes »
Tue. Dec 10th 06:35 -- 06:40 PM Room West Ballroom C
More from the Same Authors
-
2021 : DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations »
Fei Deng · Ingook Jang · Sungjin Ahn -
2021 : TransDreamer: Reinforcement Learning with Transformer World Models »
· Jaesik Yoon · Yi-Fu Wu · Sungjin Ahn -
2021 : Learning Representations for Zero-Shot Image Generation without Text »
Gautam Singh · Fei Deng · Sungjin Ahn -
2022 Poster: Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videos »
Gautam Singh · Yi-Fu Wu · Sungjin Ahn -
2020 : Invited Talk: Sungjin Ahn »
Sungjin Ahn -
2020 Poster: Generative Neurosymbolic Machines »
Jindong Jiang · Sungjin Ahn -
2020 Spotlight: Generative Neurosymbolic Machines »
Jindong Jiang · Sungjin Ahn -
2019 Poster: Variational Temporal Abstraction »
Taesup Kim · Sungjin Ahn · Yoshua Bengio -
2019 Poster: Neural Multisensory Scene Inference »
Jae Hyun Lim · Pedro O. Pinheiro · Negar Rostamzadeh · Chris Pal · Sungjin Ahn -
2018 Poster: Bayesian Model-Agnostic Meta-Learning »
Jaesik Yoon · Taesup Kim · Ousmane Dia · Sungwoong Kim · Yoshua Bengio · Sungjin Ahn -
2018 Spotlight: Bayesian Model-Agnostic Meta-Learning »
Jaesik Yoon · Taesup Kim · Ousmane Dia · Sungwoong Kim · Yoshua Bengio · Sungjin Ahn