Timezone: »

A Closer Look at the Training Strategy for Modern Meta-Learning
JIAXIN CHEN · Xiao-Ming Wu · Yanke Li · Qimai LI · Li-Ming Zhan · Fu-lai Chung

Wed Dec 09 09:00 PM -- 11:00 PM (PST) @ Poster Session 4 #1311
The support/query (S/Q) episodic training strategy has been widely used in modern meta-learning algorithms and is believed to improve their generalization ability to test environments. This paper conducts a theoretical investigation of this training strategy on generalization. From a stability perspective, we analyze the generalization error bound of generic meta-learning algorithms trained with such strategy. We show that the S/Q episodic training strategy naturally leads to a counterintuitive generalization bound of $O(1/\sqrt{n})$, which only depends on the task number $n$ but independent of the inner-task sample size $m$. Under the common assumption $m<

Author Information

JIAXIN CHEN (The Hong Kong Polytechnic University)
Xiao-Ming Wu (The Hong Kong Polytechnic University)
Yanke Li (ETH Zurich)
Qimai LI (The Hong Kong PolyU)
Li-Ming Zhan (The Hong Kong Polytechnic University)
Fu-lai Chung (The Hong Kong Polytechnic University)

More from the Same Authors