Timezone: »
Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model for FSC. In this paper we propose a novel semi-supervised meta-learning method called learning to self-train (LST) that leverages unlabeled data and specifically meta-learns how to cherry-pick and label such unsupervised data to further improve performance. To this end, we train the LST model through a large number of semi-supervised few-shot tasks. On each task, we train a few-shot model to predict pseudo labels for unlabeled data, and then iterate the self-training steps on labeled and pseudo-labeled data with each step followed by fine-tuning. We additionally learn a soft weighting network (SWN) to optimize the self-training weights of pseudo labels so that better ones can contribute more to gradient descent optimization. We evaluate our LST method on two ImageNet benchmarks for semi-supervised few-shot classification and achieve large improvements over the state-of-the-art.
Author Information
Xinzhe Li (SJTU)
Qianru Sun (Singapore Management University)
Yaoyao Liu (Tianjin University)
Qin Zhou (Alibaba Group)
Shibao Zheng (SJTU)
Tat-Seng Chua (National Univ. of Singapore)
Bernt Schiele (Max Planck Institute for Informatics)
More from the Same Authors
-
2020 : Paper 21: Haar Wavelet based Block Autoregressive Flows for Trajectories »
Apratim Bhattacharyya · Christoph-Nikolas Straehle · Mario Fritz · Bernt Schiele -
2021 Spotlight: Self-Supervised Learning Disentangled Group Representation as Feature »
Tan Wang · Zhongqi Yue · Jianqiang Huang · Qianru Sun · Hanwang Zhang -
2022 Poster: Motion Transformer with Global Intention Localization and Local Movement Refinement »
Shaoshuai Shi · Li Jiang · Dengxin Dai · Bernt Schiele -
2022 Poster: Assaying Out-Of-Distribution Generalization in Transfer Learning »
Florian Wenzel · Andrea Dittadi · Peter Gehler · Carl-Johann Simon-Gabriel · Max Horn · Dominik Zietlow · David Kernert · Chris Russell · Thomas Brox · Bernt Schiele · Bernhard Schölkopf · Francesco Locatello -
2022 Poster: Incorporating Bias-aware Margins into Contrastive Loss for Collaborative Filtering »
An Zhang · Wenchang Ma · Xiang Wang · Tat-Seng Chua -
2022 Poster: USB: A Unified Semi-supervised Learning Benchmark for Classification »
Yidong Wang · Hao Chen · Yue Fan · Wang SUN · Ran Tao · Wenxin Hou · Renjie Wang · Linyi Yang · Zhi Zhou · Lan-Zhe Guo · Heli Qi · Zhen Wu · Yu-Feng Li · Satoshi Nakamura · Wei Ye · Marios Savvides · Bhiksha Raj · Takahiro Shinozaki · Bernt Schiele · Jindong Wang · Xing Xie · Yue Zhang -
2022 Poster: LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model »
Hao Fei · Shengqiong Wu · Jingye Li · Bobo Li · Fei Li · Libo Qin · Meishan Zhang · Min Zhang · Tat-Seng Chua -
2021 Poster: RMM: Reinforced Memory Management for Class-Incremental Learning »
Yaoyao Liu · Bernt Schiele · Qianru Sun -
2021 Poster: Towards Multi-Grained Explainability for Graph Neural Networks »
Xiang Wang · Yingxin Wu · An Zhang · Xiangnan He · Tat-Seng Chua -
2021 Poster: Self-Supervised Learning Disentangled Group Representation as Feature »
Tan Wang · Zhongqi Yue · Jianqiang Huang · Qianru Sun · Hanwang Zhang -
2020 Poster: Attribute Prototype Network for Zero-Shot Learning »
Wenjia Xu · Yongqin Xian · Jiuniu Wang · Bernt Schiele · Zeynep Akata -
2020 Poster: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2020 Poster: Causal Intervention for Weakly-Supervised Semantic Segmentation »
Dong Zhang · Hanwang Zhang · Jinhui Tang · Xian-Sheng Hua · Qianru Sun -
2020 Oral: Causal Intervention for Weakly-Supervised Semantic Segmentation »
Dong Zhang · Hanwang Zhang · Jinhui Tang · Xian-Sheng Hua · Qianru Sun -
2020 Oral: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2020 Poster: Interventional Few-Shot Learning »
Zhongqi Yue · Hanwang Zhang · Qianru Sun · Xian-Sheng Hua -
2018 Poster: Adversarial Scene Editing: Automatic Object Removal from Weak Supervision »
Rakshith R Shetty · Mario Fritz · Bernt Schiele -
2017 Poster: Pose Guided Person Image Generation »
Liqian Ma · Xu Jia · Qianru Sun · Bernt Schiele · Tinne Tuytelaars · Luc Van Gool -
2016 Poster: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2016 Oral: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2015 Poster: Efficient Output Kernel Learning for Multiple Tasks »
Pratik Kumar Jawanpuria · Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Poster: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Spotlight: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2013 Poster: Transfer Learning in a Transductive Setting »
Marcus Rohrbach · Sandra Ebert · Bernt Schiele