Timezone: »

 
Poster
Attribute Prototype Network for Zero-Shot Learning
Wenjia Xu · Yongqin Xian · Jiuniu Wang · Bernt Schiele · Zeynep Akata

Wed Dec 09 09:00 AM -- 11:00 AM (PST) @ Poster Session 3 #923
in Poster Session 4 »

From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with integrated attribute localization ability would be beneficial for zero-shot learning. To this end, we propose a novel zero-shot representation learning framework that jointly learns discriminative global and local features using only class-level attributes. While a visual-semantic embedding layer learns global features, local features are learned through an attribute prototype network that simultaneously regresses and decorrelates attributes from intermediate features. We show that our locality augmented image representations achieve a new state-of-the-art on three zero-shot learning benchmarks. As an additional benefit, our model points to the visual evidence of the attributes in an image, e.g. for the CUB dataset, confirming the improved attribute localization ability of our image representation.

Author Information

Wenjia Xu (University of Chinese Academy of Sciences)
Yongqin Xian (Max Planck Institute Informatics)
Jiuniu Wang (City University of Hong Kong)
Bernt Schiele (Max Planck Institute for Informatics)
Zeynep Akata (University of Tübingen)

More from the Same Authors