Timezone: »
Poster
Learning Adaptive Value of Information for Structured Prediction
David J Weiss · Ben Taskar
Sun Dec 08 02:00 PM -- 06:00 PM (PST) @ Harrah's Special Events Center, 2nd Floor
Discriminative methods for learning structured models have enabled wide-spread use of very rich feature representations. However, the computational cost of feature extraction is prohibitive for large-scale or time-sensitive applications, often dominating the cost of inference in the models. Significant efforts have been devoted to sparsity-based model selection to decrease this cost. Such feature selection methods control computation statically and miss the opportunity to fine-tune feature extraction to each input at run-time. We address the key challenge of learning to control fine-grained feature extraction adaptively, exploiting non-homogeneity of the data. We propose an architecture that uses a rich feedback loop between extraction and prediction. The run-time control policy is learned using efficient value-function approximation, which adaptively determines the value of information of features at the level of individual variables for each input. We demonstrate significant speedups over state-of-the-art methods on two challenging datasets. For articulated pose estimation in video, we achieve a more accurate state-of-the-art model that is simultaneously 4$\times$ faster while using only a small fraction of possible features, with similar results on an OCR task.
Author Information
David J Weiss (University of Pennsylvania)
Ben Taskar (University of Washington)
More from the Same Authors
-
2014 Poster: Expectation-Maximization for Learning Determinantal Point Processes »
Jennifer A Gillenwater · Alex Kulesza · Emily Fox · Ben Taskar -
2013 Poster: Approximate Inference in Continuous Determinantal Processes »
Raja Hafiz Affandi · Emily Fox · Ben Taskar -
2013 Spotlight: Approximate Inference in Continuous Determinantal Processes »
Raja Hafiz Affandi · Emily Fox · Ben Taskar -
2012 Poster: Near-Optimal MAP Inference for Determinantal Point Processes »
Alex Kulesza · Jennifer A Gillenwater · Ben Taskar -
2012 Oral: Near-Optimal MAP Inference for Determinantal Point Processes »
Alex Kulesza · Jennifer A Gillenwater · Ben Taskar -
2010 Workshop: Coarse-to-Fine Learning and Inference »
Ben Taskar · David J Weiss · Benjamin J Sapp · Slav Petrov -
2010 Spotlight: Structured Determinantal Point Processes »
Alex Kulesza · Ben Taskar -
2010 Poster: Structured Determinantal Point Processes »
Alex Kulesza · Ben Taskar -
2010 Oral: Semi-Supervised Learning with Adversarially Missing Label Information »
Umar Syed · Ben Taskar -
2010 Session: Spotlights Session 3 »
Ben Taskar -
2010 Session: Oral Session 3 »
Ben Taskar -
2010 Poster: Semi-Supervised Learning with Adversarially Missing Label Information »
Umar Syed · Ben Taskar -
2010 Poster: Sidestepping Intractable Inference with Structured Ensemble Cascades »
David J Weiss · Benjamin J Sapp · Ben Taskar -
2009 Poster: Posterior vs Parameter Sparsity in Latent Variable Models »
Joao V Graca · Kuzman Ganchev · Ben Taskar · Fernando Pereira -
2009 Spotlight: Posterior vs Parameter Sparsity in Latent Variable Models »
Joao V Graca · Kuzman Ganchev · Ben Taskar · Fernando Pereira -
2009 Session: Oral Session 6: Theory, Optimization and Games »
Ben Taskar -
2007 Poster: Expectation Maximization, Posterior Constraints, and Statistical Alignment »
Kuzman Ganchev · Joao V Graca · Ben Taskar -
2007 Spotlight: Expectation Maximization, Posterior Constraints, and Statistical Alignment »
Kuzman Ganchev · Joao V Graca · Ben Taskar -
2007 Tutorial: Structured Prediction »
Ben Taskar