Timezone: »
Variational Message Passing (VMP) is an algorithmic implementation of the Variational Bayes (VB) method which applies only in the special case of conjugate exponential family models. We propose an extension to VMP, which we refer to as Non-conjugate Variational Message Passing (NCVMP) which aims to alleviate this restriction while maintaining modularity, allowing choice in how expectations are calculated, and integrating into an existing message-passing framework: Infer.NET. We demonstrate NCVMP on logistic binary and multinomial regression. In the multinomial case we introduce a novel variational bound for the softmax factor which is tighter than other commonly used bounds whilst maintaining computational tractability.
Author Information
David A Knowles (Stanford University)
Tom Minka (MSR)
More from the Same Authors
-
2014 Poster: A* Sampling »
Chris Maddison · Danny Tarlow · Tom Minka -
2014 Oral: A* Sampling »
Chris Maddison · Danny Tarlow · Tom Minka -
2012 Poster: A nonparametric variable clustering model »
David A Knowles · Konstantina Palla · Zoubin Ghahramani -
2009 Poster: Large Scale Nonparametric Bayesian Inference: Data Parallelisation in the Indian Buffet Process »
Shakir Mohamed · David A Knowles · Zoubin Ghahramani · Finale P Doshi-Velez -
2008 Demonstration: Infer.NET: Software for Graphical Models »
Tom Minka · John Winn · John P Guiver · Anitha Kannan -
2008 Poster: Gates »
Tom Minka · John Winn -
2008 Spotlight: Gates »
Tom Minka · John Winn -
2007 Poster: TrueSkill Through Time: Revisiting the History of Chess »
Pierre Dangauthier · Ralf Herbrich · Tom Minka · Thore K Graepel -
2007 Spotlight: TrueSkill Through Time: Revisiting the History of Chess »
Pierre Dangauthier · Ralf Herbrich · Tom Minka · Thore K Graepel -
2006 Poster: TrueSkill: A Bayesian Skill Rating System »
Ralf Herbrich · Tom Minka · Thore K Graepel -
2006 Talk: TrueSkill: A Bayesian Skill Rating System »
Ralf Herbrich · Tom Minka · Thore K Graepel