Timezone: »
In this paper, we focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously. In particular, we tackle a new setting, which is more realistic than currently addressed in the literature, where categories shift from training to test data. Hence, individual tasks do not contain complete training data for the categories in the test set. To generalize to such test data, it is crucial for individual tasks to leverage knowledge from related tasks. To this end, we propose learning an association graph to transfer knowledge among tasks for missing classes. We construct the association graph with nodes representing tasks, classes and instances, and encode the relationships among the nodes in the edges to guide their mutual knowledge transfer. By message passing on the association graph, our model enhances the categorical information of each instance, making it more discriminative. To avoid spurious correlations between task and class nodes in the graph, we introduce an assignment entropy maximization that encourages each class node to balance its edge weights. This enables all tasks to fully utilize the categorical information from related tasks. An extensive evaluation on three general benchmarks and a medical dataset for skin lesion classification reveals that our method consistently performs better than representative baselines.
Author Information
Jiayi Shen (University of Amsterdam)
Zehao Xiao (University of Amsterdam)
Xiantong Zhen (United Imaging Healthcare)
Cees Snoek (University of Amsterdam)
Marcel Worring (University of Amsterdam)
More from the Same Authors
-
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2022 : Self-Guided Diffusion Model »
TAO HU · David Zhang · Yuki Asano · Gertjan Burghouts · Cees Snoek -
2022 : Meta-Learning Makes a Better Multimodal Few-shot Learner »
Ivona Najdenkoska · Xiantong Zhen · Marcel Worring -
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2023 Poster: Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discovery »
Sarah Rastegar · Hazel Doughty · Cees Snoek -
2023 Poster: ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusion »
Yingjun Du · Zehao Xiao · Shengcai Liao · Cees Snoek -
2023 Poster: Episodic Multi-Task Learning with Heterogeneous Neural Processes »
Jiayi Shen · Xiantong Zhen · Qi Wang · Marcel Worring -
2023 Poster: Learning Unseen Modality Interaction »
Yunhua Zhang · Hazel Doughty · Cees Snoek -
2022 : Unlocking Slot Attention by Changing Optimal Transport Costs »
Yan Zhang · David Zhang · Simon Lacoste-Julien · Gertjan Burghouts · Cees Snoek -
2022 Poster: Variational Model Perturbation for Source-Free Domain Adaptation »
Mengmeng Jing · Xiantong Zhen · Jingjing Li · Cees Snoek -
2021 Poster: Learning to Learn Dense Gaussian Processes for Few-Shot Learning »
Ze Wang · Zichen Miao · Xiantong Zhen · Qiang Qiu -
2021 Poster: Variational Multi-Task Learning with Gumbel-Softmax Priors »
Jiayi Shen · Xiantong Zhen · Marcel Worring · Ling Shao -
2020 Poster: Learning to Learn Variational Semantic Memory »
Xiantong Zhen · Yingjun Du · Huan Xiong · Qiang Qiu · Cees Snoek · Ling Shao