Timezone: »
From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with integrated attribute localization ability would be beneficial for zero-shot learning. To this end, we propose a novel zero-shot representation learning framework that jointly learns discriminative global and local features using only class-level attributes. While a visual-semantic embedding layer learns global features, local features are learned through an attribute prototype network that simultaneously regresses and decorrelates attributes from intermediate features. We show that our locality augmented image representations achieve a new state-of-the-art on three zero-shot learning benchmarks. As an additional benefit, our model points to the visual evidence of the attributes in an image, e.g. for the CUB dataset, confirming the improved attribute localization ability of our image representation.
Author Information
Wenjia Xu (University of Chinese Academy of Sciences)
Yongqin Xian (Max Planck Institute Informatics)
Jiuniu Wang (City University of Hong Kong)
Bernt Schiele (Max Planck Institute for Informatics)
Zeynep Akata (University of Tübingen)
More from the Same Authors
-
2020 : Paper 21: Haar Wavelet based Block Autoregressive Flows for Trajectories »
Apratim Bhattacharyya · Christoph-Nikolas Straehle · Mario Fritz · Bernt Schiele -
2021 Workshop: ImageNet: Past, Present, and Future »
Zeynep Akata · Lucas Beyer · Sanghyuk Chun · A. Sophia Koepke · Diane Larlus · Seong Joon Oh · Rafael Rezende · Sangdoo Yun · Xiaohua Zhai -
2021 Poster: RMM: Reinforced Memory Management for Class-Incremental Learning »
Yaoyao Liu · Bernt Schiele · Qianru Sun -
2020 Poster: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2020 Oral: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring »
Jiangxin Dong · Stefan Roth · Bernt Schiele -
2019 Poster: Learning to Self-Train for Semi-Supervised Few-Shot Classification »
Xinzhe Li · Qianru Sun · Yaoyao Liu · Qin Zhou · Shibao Zheng · Tat-Seng Chua · Bernt Schiele -
2018 Poster: Adversarial Scene Editing: Automatic Object Removal from Weak Supervision »
Rakshith R Shetty · Mario Fritz · Bernt Schiele -
2017 Poster: Pose Guided Person Image Generation »
Liqian Ma · Xu Jia · Qianru Sun · Bernt Schiele · Tinne Tuytelaars · Luc Van Gool -
2016 Poster: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2016 Oral: Learning What and Where to Draw »
Scott E Reed · Zeynep Akata · Santosh Mohan · Samuel Tenka · Bernt Schiele · Honglak Lee -
2015 Poster: Efficient Output Kernel Learning for Multiple Tasks »
Pratik Kumar Jawanpuria · Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Poster: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2015 Spotlight: Top-k Multiclass SVM »
Maksim Lapin · Matthias Hein · Bernt Schiele -
2013 Poster: Transfer Learning in a Transductive Setting »
Marcus Rohrbach · Sandra Ebert · Bernt Schiele