Timezone: »
Language is an important tool for humans to share knowledge. We propose a meta-learning method that shares knowledge across supervised learning tasks using feature descriptions written in natural language, which have not been used in the existing meta-learning methods. The proposed method improves the predictive performance on unseen tasks with a limited number of labeled data by meta-learning from various tasks. With the feature descriptions, we can find relationships across tasks even when their feature spaces are different. The feature descriptions are encoded using a language model pretrained with a large corpus, which enables us to incorporate human knowledge stored in the corpus into meta-learning. In our experiments, we demonstrate that the proposed method achieves better predictive performance than the existing meta-learning methods using a wide variety of real-world datasets provided by the statistical office of the EU and Japan.
Author Information
Tomoharu Iwata (NTT)
Atsutoshi Kumagai (NTT)
More from the Same Authors
-
2022 Poster: Symplectic Spectrum Gaussian Processes: Learning Hamiltonians from Noisy and Sparse Data »
Yusuke Tanaka · Tomoharu Iwata · naonori ueda -
2022 Poster: Few-shot Learning for Feature Selection with Hilbert-Schmidt Independence Criterion »
Atsutoshi Kumagai · Tomoharu Iwata · Yasutoshi Ida · Yasuhiro Fujiwara -
2022 Poster: Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks »
Daiki Chijiwa · Shin'ya Yamaguchi · Atsutoshi Kumagai · Yasutoshi Ida -
2021 Poster: Meta-Learning for Relative Density-Ratio Estimation »
Atsutoshi Kumagai · Tomoharu Iwata · Yasuhiro Fujiwara -
2021 Poster: Loss function based second-order Jensen inequality and its application to particle variational inference »
Futoshi Futami · Tomoharu Iwata · naonori ueda · Issei Sato · Masashi Sugiyama -
2019 Poster: Transfer Anomaly Detection by Inferring Latent Domain Representations »
Atsutoshi Kumagai · Tomoharu Iwata · Yasuhiro Fujiwara -
2019 Poster: Spatially Aggregated Gaussian Processes with Multivariate Areal Outputs »
Yusuke Tanaka · Toshiyuki Tanaka · Tomoharu Iwata · Takeshi Kurashima · Maya Okawa · Yasunori Akagi · Hiroyuki Toda -
2016 Poster: Multi-view Anomaly Detection via Robust Probabilistic Latent Variable Models »
Tomoharu Iwata · Makoto Yamada -
2015 Poster: Cross-Domain Matching for Bag-of-Words Data via Kernel Embeddings of Latent Distributions »
Yuya Yoshikawa · Tomoharu Iwata · Hiroshi Sawada · Takeshi Yamada -
2014 Poster: Latent Support Measure Machines for Bag-of-Words Data Classification »
Yuya Yoshikawa · Tomoharu Iwata · Hiroshi Sawada