Timezone: »
Poster
Inference for determinantal point processes without spectral knowledge
Rémi Bardenet · Michalis Titsias
Determinantal point processes (DPPs) are point process models thatnaturally encode diversity between the points of agiven realization, through a positive definite kernel $K$. DPPs possess desirable properties, such as exactsampling or analyticity of the moments, but learning the parameters ofkernel $K$ through likelihood-based inference is notstraightforward. First, the kernel that appears in thelikelihood is not $K$, but another kernel $L$ related to $K$ throughan often intractable spectral decomposition. This issue is typically bypassed in machine learning bydirectly parametrizing the kernel $L$, at the price of someinterpretability of the model parameters. We follow this approachhere. Second, the likelihood has an intractable normalizingconstant, which takes the form of large determinant in the case of aDPP over a finite set of objects, and the form of a Fredholm determinant in thecase of a DPP over a continuous domain. Our main contribution is to derive bounds on the likelihood ofa DPP, both for finite and continuous domains. Unlike previous work, our bounds arecheap to evaluate since they do not rely on approximating the spectrumof a large matrix or an operator. Through usual arguments, these bounds thus yield cheap variationalinference and moderately expensive exact Markov chain Monte Carlo inference methods for DPPs.
Author Information
Rémi Bardenet (University of Lille)
Michalis Titsias (Athens University of Economics and Business)
More from the Same Authors
-
2021 Spotlight: Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGD »
Rémi Bardenet · Subhroshekhar Ghosh · Meixia LIN -
2021 Poster: Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGD »
Rémi Bardenet · Subhroshekhar Ghosh · Meixia LIN -
2021 Poster: Nonparametric estimation of continuous DPPs with kernel methods »
Michaël Fanuel · Rémi Bardenet -
2019 Poster: Kernel quadrature with DPPs »
Ayoub Belhadji · Rémi Bardenet · Pierre Chainais -
2019 Poster: On two ways to use determinantal point processes for Monte Carlo integration »
Guillaume Gautier · Rémi Bardenet · Michal Valko -
2011 Poster: Variational Gaussian Process Dynamical Systems »
Andreas Damianou · Michalis Titsias · Neil D Lawrence -
2011 Poster: Algorithms for Hyper-Parameter Optimization »
James Bergstra · Rémi Bardenet · Yoshua Bengio · Balázs Kégl -
2011 Poster: Spike and Slab Variational Inference for Multi-Task and Multiple Kernel Learning »
Michalis Titsias · Miguel Lazaro-Gredilla -
2008 Poster: Efficient Sampling for Gaussian Process Inference using Control Variables »
Michalis Titsias · Neil D Lawrence · Magnus Rattray -
2008 Spotlight: Efficient Sampling for Gaussian Process Inference using Control Variables »
Michalis Titsias · Neil D Lawrence · Magnus Rattray -
2007 Poster: The Infinite Gamma-Poisson Feature Model »
Michalis Titsias