Timezone: »
We establish a direct connection between general tensor networks and deep feed-forward artificial neural networks. The core of our results is the construction of neural-network layers that efficiently perform tensor contractions, and that use commonly adopted non-linear activation functions. The resulting deep networks feature a number of edges that closely matches the contraction complexity of the tensor networks to be approximated. In the context of many-body quantum states, this result establishes that neural-network states have strictly the same or higher expressive power than practically usable variational tensor networks. As an example, we show that all matrix product states can be efficiently written as neural-network states with a number of edges polynomial in the bond dimension and depth logarithmic in the system size. The opposite instead does not hold true, and our results imply that there exist quantum states that are not efficiently expressible in terms of matrix product states or practically usable PEPS, but that are instead efficiently expressible with neural network states.
Author Information
Or Sharir (California Institute of Technology)
Amnon Shashua (Hebrew University of Jerusalem)
Giuseppe Carleo (EPFL)
More from the Same Authors
-
2021 : Classical variational simulation of the Quantum Approximate Optimization Algorithm »
Matija Medvidović · Giuseppe Carleo -
2022 : Towards Neural Variational Monte Carlo That Scales Linearly with System Size »
Or Sharir · Garnet Chan · Anima Anandkumar -
2020 Poster: Limits to Depth Efficiencies of Self-Attention »
Yoav Levine · Noam Wies · Or Sharir · Hofit Bata · Amnon Shashua -
2016 Poster: Learning a Metric Embedding for Face Recognition using the Multibatch Method »
Oren Tadmor · Tal Rosenwein · Shai Shalev-Shwartz · Yonatan Wexler · Amnon Shashua -
2011 Poster: ShareBoost: Efficient multiclass learning with feature sharing »
Shai Shalev-Shwartz · Yonatan Wexler · Amnon Shashua -
2006 Poster: Nonnegative Sparse PCA »
Ron Zass · Amnon Shashua -
2006 Poster: Doubly Stochastic Normalization for Spectral Clustering »
Ron Zass · Amnon Shashua