Timezone: »
Components estimated by independent component analysis and related methods are typically not independent in real data. A very common form of nonlinear dependency between the components is correlations in their variances or ener- gies. Here, we propose a principled probabilistic model to model the energy- correlations between the latent variables. Our two-stage model includes a linear mixing of latent signals into the observed ones like in ICA. The main new fea- ture is a model of the energy-correlations based on the structural equation model (SEM), in particular, a Linear Non-Gaussian SEM. The SEM is closely related to divisive normalization which effectively reduces energy correlation. Our new two- stage model enables estimation of both the linear mixing and the interactions re- lated to energy-correlations, without resorting to approximations of the likelihood function or other non-principled approaches. We demonstrate the applicability of our method with synthetic dataset, natural images and brain signals.
Author Information
Jun-ichiro Hirayama (Kyoto University)
Aapo Hyvarinen (University of Helsinki)
Related Events (a corresponding poster, oral, or spotlight)
-
2011 Spotlight: Structural equations and divisive normalization for energy-dependent component analysis »
Mon. Dec 12th 05:40 -- 05:44 PM Room
More from the Same Authors
-
2022 : Panel Discussion »
Cheng Zhang · Mihaela van der Schaar · Ilya Shpitser · Aapo Hyvarinen · Yoshua Bengio · Bernhard Schölkopf -
2021 : Invited talk #1: Aapo Hyvärinen »
Aapo Hyvarinen -
2021 : Aapo Hyvarinen - Causal discovery by generative modelling »
Aapo Hyvarinen -
2021 Poster: Shared Independent Component Analysis for Multi-Subject Neuroimaging »
Hugo Richard · Pierre Ablin · Bertrand Thirion · Alexandre Gramfort · Aapo Hyvarinen -
2021 Poster: Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA »
Hermanni Hälvä · Sylvain Le Corff · Luc Lehéricy · Jonathan So · Yongjie Zhu · Elisabeth Gassiat · Aapo Hyvarinen -
2020 : Keynotes: Aapo Hyvärinen »
Aapo Hyvarinen -
2020 Poster: Modeling Shared responses in Neuroimaging Studies through MultiView ICA »
Hugo Richard · Luigi Gresele · Aapo Hyvarinen · Bertrand Thirion · Alexandre Gramfort · Pierre Ablin -
2020 Spotlight: Modeling Shared responses in Neuroimaging Studies through MultiView ICA »
Hugo Richard · Luigi Gresele · Aapo Hyvarinen · Bertrand Thirion · Alexandre Gramfort · Pierre Ablin -
2020 Poster: ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICA »
Ilyes Khemakhem · Ricardo Monti · Diederik Kingma · Aapo Hyvarinen -
2020 Spotlight: ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICA »
Ilyes Khemakhem · Ricardo Monti · Diederik Kingma · Aapo Hyvarinen -
2020 Poster: Relative gradient optimization of the Jacobian term in unsupervised deep learning »
Luigi Gresele · Giancarlo Fissore · Adrián Javaloy · Bernhard Schölkopf · Aapo Hyvarinen -
2016 Poster: Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA »
Aapo Hyvarinen · Hiroshi Morioka -
2016 Oral: Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA »
Aapo Hyvarinen · Hiroshi Morioka