Timezone: »

The Doubly Correlated Nonparametric Topic Model
Dae Il Kim · Erik Sudderth

Tue Dec 13 08:45 AM -- 02:59 PM (PST) @

Topic models are learned via a statistical model of variation within document collections, but designed to extract meaningful semantic structure. Desirable traits include the ability to incorporate annotations or metadata associated with documents; the discovery of correlated patterns of topic usage; and the avoidance of parametric assumptions, such as manual specification of the number of topics. We propose a doubly correlated nonparametric topic (DCNT) model, the first model to simultaneously capture all three of these properties. The DCNT models metadata via a flexible, Gaussian regression on arbitrary input features; correlations via a scalable square-root covariance representation; and nonparametric selection from an unbounded series of potential topics via a stick-breaking construction. We validate the semantic structure and predictive performance of the DCNT using a corpus of NIPS documents annotated by various metadata.

Author Information

Dae Il Kim (Brown University)
Erik Sudderth (University of California, Irvine)

More from the Same Authors