Timezone: »

 
Poster
Recovering Latent Causal Factor for Generalization to Distributional Shifts
Xinwei Sun · Botong Wu · Xiangyu Zheng · Chang Liu · Wei Chen · Tao Qin · Tie-Yan Liu

Tue Dec 07 08:30 AM -- 10:00 AM (PST) @
in Poster Session 1 »

Distributional shifts between training and target domains may degrade the prediction accuracy of learned models, mainly because these models often learn features that possess only correlation rather than causal relation with the output. Such a correlation, which is known as ``spurious correlation'' statistically, is domain-dependent hence may fail to generalize to unseen domains. To avoid such a spurious correlation, we propose \textbf{La}tent \textbf{C}ausal \textbf{I}nvariance \textbf{M}odels (LaCIM) that specifies the underlying causal structure of the data and the source of distributional shifts, guiding us to pursue only causal factor for prediction. Specifically, the LaCIM introduces a pair of correlated latent factors: (a) causal factor and (b) others, while the extent of this correlation is governed by a domain variable that characterizes the distributional shifts. On the basis of this, we prove that the distribution of observed variables conditioning on latent variables is shift-invariant. Equipped with such an invariance, we prove that the causal factor can be recovered without mixing information from others, which induces the ground-truth predicting mechanism. We propose a Variational-Bayesian-based method to learn this invariance for prediction. The utility of our approach is verified by improved generalization to distributional shifts on various real-world data. Our code is freely available at \url{https://github.com/wubotong/LaCIM}.

Keywords: Domain Adaptation

Author Information

Xinwei Sun (Peking University)
Botong Wu (Peking University)
Xiangyu Zheng (Peking University)

I am a third-year Ph.D. student at the Department of Statistics in Guanghua School of Management of Peking University. I received my Bachelor of Science degree from School of Mathematical Sciences of Beijing Normal University. My research interest is mainly on tree-based methods, the estimation of the treatment effect of policy intervention and environmental statistics in air pollution.

Chang Liu (Microsoft Research Asia)
Wei Chen (Chinese Academy of Sciences)
Tao Qin (Microsoft Research)
Tie-Yan Liu (Microsoft Research Asia)

More from the Same Authors