Timezone: »

 
Poster
Meta-Learning Requires Meta-Augmentation
Janarthanan Rajendran · Alexander Irpan · Eric Jang

Thu Dec 10 09:00 AM -- 11:00 AM (PST) @ Poster Session 5 #1326
in Poster Session 6 »

Meta-learning algorithms aim to learn two components: a model that predicts targets for a task, and a base learner that updates that model when given examples from a new task. This additional level of learning can be powerful, but it also creates another potential source of overfitting, since we can now overfit in either the model or the base learner. We describe both of these forms of meta-learning overfitting, and demonstrate that they appear experimentally in common meta-learning benchmarks. We introduce an information-theoretic framework of meta-augmentation, whereby adding randomness discourages the base learner and model from learning trivial solutions that do not generalize to new tasks. We demonstrate that meta-augmentation produces large complementary benefits to recently proposed meta-regularization techniques.

Author Information

Janarthanan Rajendran (University of Michigan)
Alexander Irpan (Research at Google)
Eric Jang (Google Brain)

More from the Same Authors