Timezone: »
Poster
One-shot learning and big data with n=2
Lee H Dicker · Dean P Foster
Sat Dec 07 07:00 PM -- 11:59 PM (PST) @ Harrah's Special Events Center, 2nd Floor #None
We model a "one-shot learning" situation, where very few (scalar) observations $y_1,...,y_n$ are available. Associated with each observation $y_i$ is a very high-dimensional vector $x_i$, which provides context for $y_i$ and enables us to predict subsequent observations, given their own context. One of the salient features of our analysis is that the problems studied here are easier when the dimension of $x_i$ is large; in other words, prediction becomes easier when more context is provided. The proposed methodology is a variant of principal component regression (PCR). Our rigorous analysis sheds new light on PCR. For instance, we show that classical PCR estimators may be inconsistent in the specified setting, unless they are multiplied by a scalar $c > 1$; that is, unless the classical estimator is expanded. This expansion phenomenon appears to be somewhat novel and contrasts with shrinkage methods ($c < 1$), which are far more common in big data analyses.
Author Information
Lee H Dicker (Rutgers University/Amazon)
Dean P Foster (University of Pennsylvania)
More from the Same Authors
-
2016 Poster: Scaled Least Squares Estimator for GLMs in Large-Scale Problems »
Murat Erdogdu · Lee H Dicker · Mohsen Bayati -
2014 Poster: large scale canonical correlation analysis with iterative least squares »
Yichao Lu · Dean P Foster -
2013 Poster: New Subsampling Algorithms for Fast Least Squares Regression »
Paramveer Dhillon · Yichao Lu · Dean P Foster · Lyle Ungar -
2013 Poster: Faster Ridge Regression via the Subsampled Randomized Hadamard Transform »
Yichao Lu · Paramveer Dhillon · Dean P Foster · Lyle Ungar -
2012 Poster: A Spectral Algorithm for Latent Dirichlet Allocation »
Anima Anandkumar · Dean P Foster · Daniel Hsu · Sham M Kakade · Yi-Kai Liu -
2012 Spotlight: A Spectral Algorithm for Latent Dirichlet Allocation »
Anima Anandkumar · Dean P Foster · Daniel Hsu · Sham M Kakade · Yi-Kai Liu -
2011 Poster: Stochastic convex optimization with bandit feedback »
Alekh Agarwal · Dean P Foster · Daniel Hsu · Sham M Kakade · Sasha Rakhlin -
2011 Poster: Multi-View Learning of Word Embeddings via CCA »
Paramveer Dhillon · Dean P Foster · Lyle Ungar