Timezone: »

PointCNN: Convolution On X-Transformed Points
Yangyan Li · Rui Bu · Mingchao Sun · Wei Wu · Xinhan Di · Baoquan Chen

Tue Dec 04 07:45 AM -- 09:45 AM (PST) @ Room 210 #42

We present a simple and general framework for feature learning from point cloud. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids (e.g. images). However, point cloud are irregular and unordered, thus a direct convolving of kernels against the features associated with the points will result in deserting the shape information while being variant to the orders. To address these problems, we propose to learn a X-transformation from the input points, which is used for simultaneously weighting the input features associated with the points and permuting them into latent potentially canonical order. Then element-wise product and sum operations of typical convolution operator are applied on the X-transformed features. The proposed method is a generalization of typical CNNs into learning features from point cloud, thus we call it PointCNN. Experiments show that PointCNN achieves on par or better performance than state-of-the-art methods on multiple challenging benchmark datasets and tasks.

Author Information

Yangyan Li (Alibaba AI Labs)
Rui Bu (Shandong University)
Mingchao Sun (Shandong University)
Wei Wu (Shandong University)
Xinhan Di (Huawei Technology Ltd)
Baoquan Chen (Shandong University)

More from the Same Authors