Timezone: »
Poster
Permuton-induced Chinese Restaurant Process
Masahiro Nakano · Yasuhiro Fujiwara · Akisato Kimura · Takeshi Yamada · naonori ueda
This paper proposes the permuton-induced Chinese restaurant process (PCRP), a stochastic process on rectangular partitioning of a matrix. This distribution is suitable for use as a prior distribution in Bayesian nonparametric relational model to find hidden clusters in matrices and network data. Our main contribution is to introduce the notion of permutons into the well-known Chinese restaurant process (CRP) for sequence partitioning: a permuton is a probability measure on $[0,1]\times [0,1]$ and can be regarded as a geometric interpretation of the scaling limit of permutations. Specifically, we extend the model that the table order of CRPs has a random geometric arrangement on $[0,1]\times [0,1]$ drawn from the permuton. By analogy with the relationship between the stick-breaking process (SBP) and CRP for the infinite mixture model of a sequence, this model can be regarded as a multi-dimensional extension of CRP paired with the block-breaking process (BBP), which has been recently proposed as a multi-dimensional extension of SBP. While BBP always has an infinite number of redundant intermediate variables, PCRP can be composed of varying size intermediate variables in a data-driven manner depending on the size and quality of the observation data. Experiments show that PCRP can improve the prediction performance in relational data analysis by reducing the local optima and slow mixing problems compared with the conventional BNP models because the local transitions of PCRP in Markov chain Monte Carlo inference are more flexible than the previous models.
Author Information
Masahiro Nakano (NTT Communication Science Laboratories)
Yasuhiro Fujiwara (NTT Software Innovation Center)
Akisato Kimura (NTT Communication Science Laboratories)
Takeshi Yamada (NTT Communication Science Laboratories)
naonori ueda (NTT Communication Science Labs. / RIKEN AIP)
More from the Same Authors
-
2022 Poster: Symplectic Spectrum Gaussian Processes: Learning Hamiltonians from Noisy and Sparse Data »
Yusuke Tanaka · Tomoharu Iwata · naonori ueda -
2021 Poster: Meta-Learning for Relative Density-Ratio Estimation »
Atsutoshi Kumagai · Tomoharu Iwata · Yasuhiro Fujiwara -
2021 Poster: Loss function based second-order Jensen inequality and its application to particle variational inference »
Futoshi Futami · Tomoharu Iwata · naonori ueda · Issei Sato · Masashi Sugiyama -
2020 Poster: Baxter Permutation Process »
Masahiro Nakano · Akisato Kimura · Takeshi Yamada · Naonori Ueda -
2020 Spotlight: Baxter Permutation Process »
Masahiro Nakano · Akisato Kimura · Takeshi Yamada · Naonori Ueda -
2019 Poster: Fully Neural Network based Model for General Temporal Point Processes »
Takahiro Omi · naonori ueda · Kazuyuki Aihara -
2018 Poster: Sigsoftmax: Reanalysis of the Softmax Bottleneck »
Sekitoshi Kanai · Yasuhiro Fujiwara · Yuki Yamanaka · Shuichi Adachi -
2017 Poster: Preventing Gradient Explosions in Gated Recurrent Units »
Sekitoshi Kanai · Yasuhiro Fujiwara · Sotetsu Iwamura -
2015 Poster: Cross-Domain Matching for Bag-of-Words Data via Kernel Embeddings of Latent Distributions »
Yuya Yoshikawa · Tomoharu Iwata · Hiroshi Sawada · Takeshi Yamada -
2009 Poster: Modeling Social Annotation Data with Content Relevance using a Topic Model »
Tomoharu Iwata · Takeshi Yamada · Naonori Ueda