Timezone: »
We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal Model (SCM) for the causalities among the pre-trained knowledge, sample features, and labels. Thanks to it, we propose a novel FSL paradigm: Interventional Few-Shot Learning (IFSL). Specifically, we develop three effective IFSL algorithmic implementations based on the backdoor adjustment, which is essentially a causal intervention towards the SCM of many-shot learning: the upper-bound of FSL in a causal view. It is worth noting that the contribution of IFSL is orthogonal to existing fine-tuning and meta-learning based FSL methods, hence IFSL can improve all of them, achieving a new 1-/5-shot state-of-the-art on miniImageNet, tieredImageNet, and cross-domain CUB. Code is released at https://github.com/yue-zhongqi/ifsl.
Author Information
Zhongqi Yue (Nanyang Technological University)
Hanwang Zhang (NTU)
Qianru Sun (Singapore Management University)
Xian-Sheng Hua (Damo Academy, Alibaba Group)
More from the Same Authors
-
2021 Spotlight: Self-Supervised Learning Disentangled Group Representation as Feature »
Tan Wang · Zhongqi Yue · Jianqiang Huang · Qianru Sun · Hanwang Zhang -
2022 Poster: Respecting Transfer Gap in Knowledge Distillation »
Yulei Niu · Long Chen · Chang Zhou · Hanwang Zhang -
2021 Poster: RMM: Reinforced Memory Management for Class-Incremental Learning »
Yaoyao Liu · Bernt Schiele · Qianru Sun -
2021 Poster: Self-Supervised Learning Disentangled Group Representation as Feature »
Tan Wang · Zhongqi Yue · Jianqiang Huang · Qianru Sun · Hanwang Zhang -
2021 Poster: How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? »
Xinshuai Dong · Anh Tuan Luu · Min Lin · Shuicheng Yan · Hanwang Zhang -
2021 Poster: Introspective Distillation for Robust Question Answering »
Yulei Niu · Hanwang Zhang -
2020 Poster: Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect »
Kaihua Tang · Jianqiang Huang · Hanwang Zhang -
2020 Poster: Causal Intervention for Weakly-Supervised Semantic Segmentation »
Dong Zhang · Hanwang Zhang · Jinhui Tang · Xian-Sheng Hua · Qianru Sun -
2020 Oral: Causal Intervention for Weakly-Supervised Semantic Segmentation »
Dong Zhang · Hanwang Zhang · Jinhui Tang · Xian-Sheng Hua · Qianru Sun -
2019 Poster: Learning to Self-Train for Semi-Supervised Few-Shot Classification »
Xinzhe Li · Qianru Sun · Yaoyao Liu · Qin Zhou · Shibao Zheng · Tat-Seng Chua · Bernt Schiele -
2018 Poster: Low-shot Learning via Covariance-Preserving Adversarial Augmentation Networks »
Hang Gao · Zheng Shou · Alireza Zareian · Hanwang Zhang · Shih-Fu Chang -
2017 Poster: Pose Guided Person Image Generation »
Liqian Ma · Xu Jia · Qianru Sun · Bernt Schiele · Tinne Tuytelaars · Luc Van Gool