Timezone: »

 
Poster
Stochastic Gradient Geodesic MCMC Methods
Chang Liu · Jun Zhu · Yang Song

Tue Dec 06 09:00 AM -- 12:30 PM (PST) @ Area 5+6+7+8 #138
in Tuesday Posters »

We propose two stochastic gradient MCMC methods for sampling from Bayesian posterior distributions defined on Riemann manifolds with a known geodesic flow, e.g. hyperspheres. Our methods are the first scalable sampling methods on these manifolds, with the aid of stochastic gradients. Novel dynamics are conceived and 2nd-order integrators are developed. By adopting embedding techniques and the geodesic integrator, the methods do not require a global coordinate system of the manifold and do not involve inner iterations. Synthetic experiments show the validity of the method, and its application to the challenging inference for spherical topic models indicate practical usability and efficiency.

Keywords: MCMC · Large Scale Learning and Big Data · (Other) Bayesian Inference
[ PDF] 

Author Information

Chang Liu (Tsinghua University)
Jun Zhu (Tsinghua University)
Yang Song (Stanford University)

More from the Same Authors