Timezone: »
Reasoning over an instance composed of a set of vectors, like a point cloud, requires that one accounts for intra-set dependent features among elements. However, since such instances are unordered, the elements' features should remain unchanged when the input's order is permuted. This property, permutation equivariance, is a challenging constraint for most neural architectures. While recent work has proposed global pooling and attention-based solutions, these may be limited in the way that intradependencies are captured in practice. In this work we propose a more general formulation to achieve permutation equivariance through ordinary differential equations (ODE). Our proposed module, Exchangeable Neural ODE (ExNODE), can be seamlessly applied for both discriminative and generative tasks. We also extend set modeling in the temporal dimension and propose a VAE based model for temporal set modeling. Extensive experiments demonstrate the efficacy of our method over strong baselines.
Author Information
Yang Li (UNC-Chapel Hill)
Haidong Yi (Department of Computer Science, UNC Chapel-Hill)
Chris Bender (The University of North Carolina)
Siyuan Shan (University of North Carolina at Chapel Hill)
Junier Oliva (UNC - Chapel Hill)
More from the Same Authors
-
2020 Poster: Meta-Neighborhoods »
Siyuan Shan · Yang Li · Junier Oliva -
2019 Workshop: Sets and Partitions »
Nicholas Monath · Manzil Zaheer · Andrew McCallum · Ari Kobren · Junier Oliva · Barnabas Poczos · Ruslan Salakhutdinov -
2019 Poster: Meta-Curvature »
Eunbyung Park · Junier Oliva