Timezone: »

 
Demonstration
Monte: An Interactive Ssytem for Massively Parallel Probabilistic Programming
Vikash Mansinghka

Wed Dec 09 12:00 AM -- 12:00 AM (PST) @
in Demonstrations »

We demonstrate Monte, a massively parallel implementation of the probabilistic programming language Church. Using Monte, a probabilistic modeler or machine learning researcher can specify state-of-the-art nonparametric Bayesian models in just 10-20 lines of code, and automatically perform inference on them in the presence of arbitrary datasets. Monte also allows a probabilistic modeler to exploit Amazon's Elastic Compute Cloud (EC2) to perform massively parallel inference, significantly increasing the model complexity and dataset scale that Monte can handle over serial implementations of probabilistic programming languages. Church is a probabilistic programming language, based on Lisp, that enables compact specification of all computable probabilistic models and supports universal Bayesian inference via Markov chain Monte Carlo. Probabilistic programming languages have gained substantial attention in the NIPS community, serving as a representation language for probabilistic machine learning and the basis of a widely attended NIPS 2008 Workshop. However, very few implementations of probabilistic programming languages have been mature enough to support reliable interactive use. The Monte implementation of Church, developed at Navia Systems, Inc., is one of the first such systems. The best evidence of its robustness and interactivity lies in the compactness of Monte representations of state-of-the-art probabilistic models (see Figure 1) and in the simplicity of its use on a single processor workstation (see Figure 2). Users of our demonstration system will be able to implement state-of-the-art probabilistic models from the current NIPS conference and immediately perform inference on them in real time using Monte's engine, collecting and analyzing posterior samples of interest. Figure 2 shows one example of this use pattern in the context of a Dirichlet process Mixture Model with binary data.

Author Information

Vikash Mansinghka (Massachusetts Institute of Technology)

Vikash Mansinghka is a research scientist at MIT, where he leads the Probabilistic Computing Project. Vikash holds S.B. degrees in Mathematics and in Computer Science from MIT, as well as an M.Eng. in Computer Science and a PhD in Computation. He also held graduate fellowships from the National Science Foundation and MIT’s Lincoln Laboratory. His PhD dissertation on natively probabilistic computation won the MIT George M. Sprowls dissertation award in computer science, and his research on the Picture probabilistic programming language won an award at CVPR. He served on DARPA’s Information Science and Technology advisory board from 2010-2012, and currently serves on the editorial boards for the Journal of Machine Learning Research and the journal Statistics and Computation. He was an advisor to Google DeepMind and has co-founded two AI-related startups, one acquired and one currently operational.

More from the Same Authors