Poster
Non-conjugate Variational Message Passing for Multinomial and Binary Regression
David A Knowles · Tom Minka

Mon Dec 12th 07:00 -- 11:59 PM @ None #None
in Poster Session and Reception »

Variational Message Passing (VMP) is an algorithmic implementation of the Variational Bayes (VB) method which applies only in the special case of conjugate exponential family models. We propose an extension to VMP, which we refer to as Non-conjugate Variational Message Passing (NCVMP) which aims to alleviate this restriction while maintaining modularity, allowing choice in how expectations are calculated, and integrating into an existing message-passing framework: Infer.NET. We demonstrate NCVMP on logistic binary and multinomial regression. In the multinomial case we introduce a novel variational bound for the softmax factor which is tighter than other commonly used bounds whilst maintaining computational tractability.

Author Information

David A Knowles (Stanford University)
Tom Minka (MSR)

More from the Same Authors