Timezone: »
We present a novel approach to inference in conditionally Gaussian continuous time stochastic processes, where the latent process is a Markovian jump process. We first consider the case of jump-diffusion processes, where the drift of a linear stochastic differential equation can jump at arbitrary time points. We derive partial differential equations for exact inference and present a very efficient mean field approximation. By introducing a novel lower bound on the free energy, we then generalise our approach to Gaussian processes with arbitrary covariance, such as the non-Markovian RBF covariance. We present results on both simulated and real data, showing that the approach is very accurate in capturing latent dynamics and can be useful in a number of real data modelling tasks.
Author Information
Manfred Opper (Technische Universitaet Berlin)
Andreas Ruttor (TU Berlin)
Guido Sanguinetti (University of Edinburgh)
More from the Same Authors
-
2021 : Resilience of Bayesian Layer-Wise Explanations under Adversarial Attacks »
Ginevra Carbone · Luca Bortolussi · Guido Sanguinetti -
2023 Poster: Attacks on Online Learners: a Teacher-Student Analysis »
Riccardo Giuseppe Margiotta · Sebastian Goldt · Guido Sanguinetti -
2020 Poster: Robustness of Bayesian Neural Networks to Gradient-Based Attacks »
Ginevra Carbone · Matthew Wicker · Luca Laurenti · Andrea Patane' · Luca Bortolussi · Guido Sanguinetti -
2015 Poster: A Tractable Approximation to Optimal Point Process Filtering: Application to Neural Encoding »
Yuval Harel · Ron Meir · Manfred Opper -
2015 Spotlight: A Tractable Approximation to Optimal Point Process Filtering: Application to Neural Encoding »
Yuval Harel · Ron Meir · Manfred Opper -
2014 Poster: Poisson Process Jumping between an Unknown Number of Rates: Application to Neural Spike Data »
Florian Stimberg · Andreas Ruttor · Manfred Opper -
2014 Spotlight: Poisson Process Jumping between an Unknown Number of Rates: Application to Neural Spike Data »
Florian Stimberg · Andreas Ruttor · Manfred Opper -
2013 Poster: Approximate inference in latent Gaussian-Markov models from continuous time observations »
Botond Cseke · Manfred Opper · Guido Sanguinetti -
2013 Spotlight: Approximate inference in latent Gaussian-Markov models from continuous time observations »
Botond Cseke · Manfred Opper · Guido Sanguinetti -
2013 Poster: Approximate Gaussian process inference for the drift function in stochastic differential equations »
Andreas Ruttor · Philipp Batz · Manfred Opper -
2011 Poster: Inference in continuous time changepoint point models »
Florian Stimberg · Manfred Opper · Guido Sanguinetti · Andreas Ruttor -
2008 Poster: Improving on Expectation Propagation »
Manfred Opper · Ulrich Paquet · Ole Winther -
2008 Spotlight: Improving on Expectation Propagation »
Manfred Opper · Ulrich Paquet · Ole Winther -
2007 Poster: Variational inference for Markov jump processes »
Manfred Opper · Guido Sanguinetti -
2007 Poster: Variational Inference for Diffusion Processes »
Cedric Archambeau · Manfred Opper · Yuan Shen · Dan Cornford · John Shawe-Taylor -
2006 Workshop: Dynamical Systems, Stochastic Processes and Bayesian Inference »
Manfred Opper · Cedric Archambeau · John Shawe-Taylor -
2006 Poster: Modelling transcriptional regulation using Gaussian Processes »
Neil D Lawrence · Guido Sanguinetti · Magnus Rattray