Timezone: »
Low-dimensional embeddings, from classical spectral embeddings to modern neural-net-inspired methods, are a cornerstone in the modeling and analysis of complex networks. Recent work by Seshadhri et al. (PNAS 2020) suggests that such embeddings cannot capture local structure arising in complex networks. In particular, they show that any network generated from a natural low-dimensional model cannot be both sparse and have high triangle density (high clustering coefficient), two hallmark properties of many real-world networks.
In this work we show that the results of Seshadhri et al. are intimately connected to the model they use rather than the low-dimensional structure of complex networks. Specifically, we prove that a minor relaxation of their model can generate sparse graphs with high triangle density. Surprisingly, we show that this same model leads to exact low-dimensional factorizations of many real-world networks. We give a simple algorithm based on logistic principal component analysis (LPCA) that succeeds in finding such exact embeddings. Finally, we perform a large number of experiments that verify the ability of very low-dimensional embeddings to capture local structure in real-world networks.
Author Information
Sudhanshu Chanpuriya (University of Massachusetts Amherst)
Cameron Musco (University of Massachusetts Amherst)
Konstantinos Sotiropoulos (Boston University)
Charalampos Tsourakakis (Boston University/ISI foundation)
More from the Same Authors
-
2023 Poster: No-regret Algorithms for Fair Resource Allocation »
Abhishek Sinha · Ativ Joshi · Rajarshi Bhattacharjee · Cameron Musco · Mohammad Hajiesmaili -
2023 Poster: Exact Representation of Sparse Networks with Symmetric Nonnegative Embeddings »
Sudhanshu Chanpuriya · Ryan Rossi · Anup Rao · Tung Mai · Nedim Lipka · Zhao Song · Cameron Musco -
2023 Poster: Finite Population Regression Adjustment and Non-asymptotic Guarantees for Treatment Effect Estimation »
Mehrdad Ghadiri · David Arbour · Tung Mai · Cameron Musco · Anup Rao -
2022 Spotlight: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2022 Poster: Kernel Interpolation with Sparse Grids »
Mohit Yadav · Daniel Sheldon · Cameron Musco -
2022 Poster: Modeling Transitivity and Cyclicity in Directed Graphs via Binary Code Box Embeddings »
Dongxu Zhang · Michael Boratko · Cameron Musco · Andrew McCallum -
2022 Poster: Simplified Graph Convolution with Heterophily »
Sudhanshu Chanpuriya · Cameron Musco -
2022 Poster: Sample Constrained Treatment Effect Estimation »
Raghavendra Addanki · David Arbour · Tung Mai · Cameron Musco · Anup Rao -
2021 Poster: On the Power of Edge Independent Graph Models »
Sudhanshu Chanpuriya · Cameron Musco · Konstantinos Sotiropoulos · Charalampos Tsourakakis -
2021 Poster: Coresets for Classification – Simplified and Strengthened »
Tung Mai · Cameron Musco · Anup Rao -
2020 Poster: Fourier Sparse Leverage Scores and Approximate Kernel Learning »
Tamas Erdelyi · Cameron Musco · Christopher Musco -
2020 Spotlight: Fourier Sparse Leverage Scores and Approximate Kernel Learning »
Tamas Erdelyi · Cameron Musco · Christopher Musco -
2019 Poster: Toward a Characterization of Loss Functions for Distribution Learning »
Nika Haghtalab · Cameron Musco · Bo Waggoner