VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data (bibtex)
by Chao Ma, Sebastian Tschiatschek, José Miguel Hernández-Lobato, Richard Turner, Cheng Zhang
Abstract:
Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and features of the same type having different marginal distributions. We propose an extension of variational autoencoders (VAEs) called VAEM to handle such heterogeneous data. VAEM is a deep generative model that is trained in a two stage manner such that the first stage provides a more uniform representation of the data to the second stage, thereby sidestepping the problems caused by heterogeneous data. We provide extensions of VAEM to handle partially observed data, and demonstrate its performance in data generation, missing data prediction and sequential feature selection tasks. Our results show that VAEM broadens the range of real-world applications where deep generative models can be successfully deployed.
Reference:
VAEM: a Deep Generative Model for Heterogeneous Mixed Type DataChao Ma, Sebastian Tschiatschek, José Miguel Hernández-Lobato, Richard Turner, Cheng Zhang In arXiv 2020.
Bibtex Entry:
@inproceedings{Ma2020VAEM,
    title={VAEM: a Deep Generative Model for Heterogeneous Mixed Type Data},
    author={Chao Ma and Sebastian Tschiatschek and José Miguel Hernández-Lobato and Richard Turner and Cheng Zhang},
    year={2020},
    booktitle={arXiv},
    url = {https://arxiv.org/pdf/2006.11941.pdf},
    abstract = {Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and features of the same type having different marginal distributions. We propose an extension of variational autoencoders (VAEs) called VAEM to handle such heterogeneous data. VAEM is a deep generative model that is trained in a two stage manner such that the first stage provides a more uniform representation of the data to the second stage, thereby sidestepping the problems caused by heterogeneous data. We provide extensions of VAEM to handle partially observed data, and demonstrate its performance in data generation, missing data prediction and sequential feature selection tasks. Our results show that VAEM broadens the range of real-world applications where deep generative models can be successfully deployed.},
    teaserImage={figures/pmi/ma2020VAEM.png},
    teaserCaption={Our VAEM accurately generates marginals and pairwise-marginals of real-world datasets},
    tag={PMI,SDM}
}
Powered by bibtexbrowser