Timezone: »

 
Poster
Nonlocal Neural Networks, Nonlocal Diffusion and Nonlocal Modeling
Yunzhe Tao · Qi Sun · Qiang Du · Wei Liu

Thu Dec 06 07:45 AM -- 09:45 AM (PST) @ Room 210 #85
in Thu Poster Session A »

Nonlocal neural networks have been proposed and shown to be effective in several computer vision tasks, where the nonlocal operations can directly capture long-range dependencies in the feature space. In this paper, we study the nature of diffusion and damping effect of nonlocal networks by doing spectrum analysis on the weight matrices of the well-trained networks, and then propose a new formulation of the nonlocal block. The new block not only learns the nonlocal interactions but also has stable dynamics, thus allowing deeper nonlocal structures. Moreover, we interpret our formulation from the general nonlocal modeling perspective, where we make connections between the proposed nonlocal network and other nonlocal models, such as nonlocal diffusion process and Markov jump process.

Keywords: Supervised Deep Networks · CNN Architectures
[ Paper] 

Author Information

Yunzhe Tao (Columbia University)
Qi Sun (CSRC & USTC & CU)
Qiang Du (Columbia University)
Wei Liu (Tencent AI Lab)

More from the Same Authors