Timezone: »

 
Fully-Connected Tensor Network Decomposition
Yu-Bang Zheng · Ting-Zhu Huang · Xi-Le Zhao · Qibin Zhao · Tai-Xiang Jiang

@
in Second Workshop on Quantum Tensor Networks in Machine Learning »
The popular tensor train (TT) and tensor ring (TR) decompositions have achieved promising results in science and engineering. However, TT and TR decompositions only establish an operation between adjacent two factors and are highly sensitive to the permutation of tensor modes, leading to an inadequate and inflexible representation. In this paper, we propose a generalized tensor decomposition, which decomposes an $N$th-order tensor into a set of $N$th-order factors and establishes an operation between any two factors. Since it can be graphically interpreted as a fully-connected network, we named it fully-connected tensor network (FCTN) decomposition. The superiorities of the FCTN decomposition lie in the outstanding capability for characterizing adequately the intrinsic correlations between any two modes of tensors and the essential invariance for transposition. Furthermore, we employ the FCTN decomposition to one representative task, i.e., tensor completion, and develop an efficient solving algorithm based on proximal alternating minimization. Theoretically, we prove the convergence of the developed algorithm, i.e., the sequence obtained by it globally converges to a critical point. Experimental results substantiate that the proposed method compares favorably to the state-of-the-art methods based on other tensor decompositions.

Author Information

Yu-Bang Zheng (School of Mathematical Sciences, University of Electronic Science and Technology of China)
Ting-Zhu Huang (School of Mathematical Sciences, University of Electronic Science and Technology of China)
Xi-Le Zhao (School of Mathematical Sciences, University of Electronic Science and Technology of China)
Qibin Zhao (RIKEN AIP)
Tai-Xiang Jiang (School of Economic Information Engineering, Southwestern University of Finance and Economics)

More from the Same Authors