Timezone: »
Poster
Importance Weighting and Variational Inference
Justin Domke · Daniel Sheldon
Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI) technique is an instance of augmented variational inference, thus identifying the looseness in previous work. Experiments confirm IWVI's practicality for probabilistic inference. As a second contribution, we investigate inference with elliptical distributions, which improves accuracy in low dimensions, and convergence in high dimensions.
Author Information
Justin Domke (University of Massachusetts, Amherst)
Daniel Sheldon (University of Massachusetts Amherst)
More from the Same Authors
-
2022 Spotlight: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2022 Poster: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2021 Poster: Relaxed Marginal Consistency for Differentially Private Query Answering »
Ryan McKenna · Siddhant Pradhan · Daniel Sheldon · Gerome Miklau -
2021 Poster: MCMC Variational Inference via Uncorrected Hamiltonian Annealing »
Tomas Geffner · Justin Domke -
2021 Poster: Amortized Variational Inference for Simple Hierarchical Models »
Abhinav Agrawal · Justin Domke -
2020 Poster: Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimization »
Abhinav Agrawal · Daniel Sheldon · Justin Domke -
2020 Poster: Approximation Based Variance Reduction for Reparameterization Gradients »
Tomas Geffner · Justin Domke -
2020 Poster: Permute-and-Flip: A new mechanism for differentially private selection »
Ryan McKenna · Daniel Sheldon -
2020 Spotlight: Permute-and-Flip: A new mechanism for differentially private selection »
Ryan McKenna · Daniel Sheldon -
2019 Poster: Thompson Sampling and Approximate Inference »
My Phan · Yasin Abbasi Yadkori · Justin Domke -
2019 Poster: Provable Gradient Variance Guarantees for Black-Box Variational Inference »
Justin Domke -
2019 Poster: Divide and Couple: Using Monte Carlo Variational Objectives for Posterior Approximation »
Justin Domke · Daniel Sheldon -
2019 Spotlight: Divide and Couple: Using Monte Carlo Variational Objectives for Posterior Approximation »
Justin Domke · Daniel Sheldon -
2019 Poster: Differentially Private Bayesian Linear Regression »
Garrett Bernstein · Daniel Sheldon -
2018 Poster: Differentially Private Bayesian Inference for Exponential Families »
Garrett Bernstein · Daniel Sheldon -
2018 Poster: Using Large Ensembles of Control Variates for Variational Inference »
Tomas Geffner · Justin Domke -
2018 Poster: Inferring Latent Velocities from Weather Radar Data using Gaussian Processes »
Rico Angell · Daniel Sheldon -
2016 Poster: Probabilistic Inference with Generating Functions for Poisson Latent Variable Models »
Kevin Winner · Daniel Sheldon -
2014 Poster: Stochastic Network Design in Bidirected Trees »
Xiaojian Wu · Daniel Sheldon · Shlomo Zilberstein -
2013 Workshop: Machine Learning for Sustainability »
Edwin Bonilla · Thomas Dietterich · Theodoros Damoulas · Andreas Krause · Daniel Sheldon · Iadine Chades · J. Zico Kolter · Bistra Dilkina · Carla Gomes · Hugo P Simao -
2011 Poster: Collective Graphical Models »
Daniel Sheldon · Thomas Dietterich -
2007 Spotlight: Collective Inference on Markov Models for Modeling Bird Migration »
Daniel Sheldon · M.A. Saleh Elmohamed · Dexter Kozen -
2007 Poster: Collective Inference on Markov Models for Modeling Bird Migration »
Daniel Sheldon · M.A. Saleh Elmohamed · Dexter Kozen