Timezone: »

 
Spotlight
Reconciling meta-learning and continual learning with online mixtures of tasks
Ghassen Jerfel · Erin Grant · Tom Griffiths · Katherine Heller

Wed Dec 11 04:20 PM -- 04:25 PM (PST) @ West Ballroom A + B
in Track 3 Session 4 »

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably dissimilar or change over time. We use the connection between gradient-based meta-learning and hierarchical Bayes to propose a Dirichlet process mixture of hierarchical Bayesian models over the parameters of an arbitrary parametric model such as a neural network. In contrast to consolidating inductive biases into a single set of hyperparameters, our approach of task-dependent hyperparameter selection better handles latent distribution shift, as demonstrated on a set of evolving, image-based, few-shot learning benchmarks.

[ Paper]  [ Slides]  [ Slides] 

Author Information

Ghassen Jerfel (Duke University)
Erin Grant (UC Berkeley)
Tom Griffiths (Princeton University)
Katherine Heller (Google)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors