Timezone: »

VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data
Chao Ma · Sebastian Tschiatschek · Richard Turner · José Miguel Hernández-Lobato · Cheng Zhang

Thu Dec 10 09:00 AM -- 11:00 AM (PST) @ Poster Session 5 #1365

Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and features of the same type having different marginal distributions. We propose an extension of variational autoencoders (VAEs) called VAEM to handle such heterogeneous data. VAEM is a deep generative model that is trained in a two stage manner, such that the first stage provides a more uniform representation of the data to the second stage, thereby sidestepping the problems caused by heterogeneous data. We provide extensions of VAEM to handle partially observed data, and demonstrate its performance in data generation, missing data prediction and sequential feature selection tasks. Our results show that VAEM broadens the range of real-world applications where deep generative models can be successfully deployed.

Author Information

Chao Ma (University of Cambridge)
Sebastian Tschiatschek (Microsoft Research)
Richard Turner (University of Cambridge)
Jose Miguel Hernández-Lobato (University of Cambridge)
Cheng Zhang (Microsoft Research, Cambridge, UK)

More from the Same Authors