Timezone: »

Spike and Slab Variational Inference for Multi-Task and Multiple Kernel Learning
Michalis Titsias · Miguel Lazaro-Gredilla

Mon Dec 12 10:00 AM -- 02:59 PM (PST) @

We introduce a variational Bayesian inference algorithm which can be widely applied to sparse linear models. The algorithm is based on the spike and slab prior which, from a Bayesian perspective, is the golden standard for sparse inference. We apply the method to a general multi-task and multiple kernel learning model in which a common set of Gaussian process functions is linearly combined with task-specific sparse weights, thus inducing relation between tasks. This model unifies several sparse linear models, such as generalized linear models, sparse factor analysis and matrix factorization with missing values, so that the variational algorithm can be applied to all these cases. We demonstrate our approach in multi-output Gaussian process regression, multi-class classification, image processing applications and collaborative filtering.

Author Information

Michalis Titsias (Athens University of Economics and Business)
Miguel Lazaro-Gredilla (DeepMind)

More from the Same Authors